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Preface 


The aim of this book is to give a rapid introduction to differential 
equations which is elementary and which emphasizes the geometric 
nature of the subject. 

The book is elementary in the sense that it assumes only a know- 
ledge of the simplest properties of differentiation and integration. 
It is designed primarily for first-year college and university students 
who have not yet had courses in analysis or linear algebra. For this 
reason topics which are of only specialized interest (such as approxi- 
mation techniques and numerical methods of solution) and more 
advanced topics which require linear algebra and analysis (such as 
existence theorems, partial differential equations and series solutions) 
are either omitted or mentioned briefly in the guide to further 
reading. Occasionally, in order to give a precise statement of a 
definition or proof, it is necessary to use a property of continuous 
functions from an analysis course. The reader should accept such 
properties —- which are usually ‘intuitively’ obvious — until he feels 
ready to look up further details in a book on analysis, such as A 
Preliminary Course in Analysis by R. M. F. Moss and G. T. Roberts 
(which has appeared in the same series, and is in the sequel referred 
to simply as Moss-Roberts). In this way the book should be suitable 
both for students specializing in mathematics and for students in 
other subjects who need differential equations as a tool. The latter 
group are warned, however, that they will not find the customary 
large number of examples of differential equations arising in biology, 
chemistry, economics, engineering and physics. The reason is that 
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such students are likely to study many examples in their own work, 
and are not likely to be helped by examples from a background 
which they do not understand. 

The approach is geometric, as can be seen from the large number 
of diagrams. The main reason is that most mistakes in differential 
equations result from blindly manipulating formulae without think- 
ing about the geometry involved. A geometric point of view is often 
necessary for applications, in which the required ‘solution’ of a 
differential equation is a picture rather than a formula. Finally, the 
geometric theory of differential equations has during the last hundred 
years developed from the elementary beginnings described in this 
book to an exciting area of research in which algebra, analysis and 
topology all play a vital role. 

I am grateful to Ronald Brown for his suggestion that such a 
book should appear in the Chapman and Hall Mathematics Series, 
to Oxford Illustrators Ltd for their help with the diagrams, and 
to the publishers and printers for their careful and sympathetic 
co-operation. 


R.L.E.S. 
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Symbol 


cos, sin 
cosh, sinh 


Glossary of 
Symbols 


Meaning 


cosine, sine 

hyperbolic cosine, hyperbolic sine 
exponential 

logarithm to base e= exp 1 

real part, imaginary part 

line of real numbers 

plane of pairs of real numbers 

set of infinitely differentiable functions f with 
fixed domain 

vector space 

domain of function 

region in R2 

belongs to 

function f which associates real number f(t) 
to each re D 

function f which associates value f(t) to each 
t in domain 


derivative of function 
partial derivatives of f(t, x) with respect to 
| Poe 


positive square root (real number y >0 such 
that y? = x) of real number x > 0 


xi 


GLOSSARY OF SYMBOLS 
cube root (real number y such that y3 = x) of 


real number x 27 
modulus (x if x >0 and — x if x <0) of real 
number x 30 


set of all x such that property P(x) holds 
(often context implies x € R) 8 


Introduction 


This book is based on a course of twenty lectures given to first-year 
mathematics students at the University of Warwick. One aim of 
the course was to provide an antidote to the ‘abstract’ courses on 
sets and groups which the students attended simultaneously in their 
first term. Another was to stimulate geometric intuition and to 
provide motivation for the courses on analysis and linear algebra 
which the students attended in the following term. 

These aims implied already that the course should be ‘concrete’ 
rather than ‘abstract’. There is, however, another reason for this 
approach. It is a common complaint among undergraduates that 
university mathematics seems unnecessarily abstract compared with 
the concrete mathematics they meet at school. Another aim of this 
book is therefore to deal with differential equations in a rather 
concrete manner, and to show how this leads naturally to such 
‘abstract’ concepts as continuous function, vector space and linear 
operator. 

In fact it is sometimes the school — rather than university — treat- 
ment of differential equations which is unnecessarily abstract. 
Consider for example the differentiation of functions like y = log x 
and y=sin x. It is familiar that the derivatives are 1/x and cos x. 
It may seem pedantic to point out that this is not quite accurate, 
since the function y=log x makes sense only for x>0, whereas 
its alleged derivative 1/x makes sense both for x > 0 and for x <0. 

To see why such pedantry may be very necessary, consider the 
differentiation of a function of a function. The well-known chain 
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y=log x, x>0 


rule gives 


2 (log sin x) = — 24 


in x 
d 1 
2 (log log x) = pyre 


@ (log log sin x) =~ Wa LS 

dx sin x log sin x 

However, these computations are somewhat abstract: an attempt 
to draw the graphs of the functions involved shows that the first 
two equations are often meaningless, while the third equation is 
always meaningless. Since y=log x makes sense only for x>0, 
the function y = log sin x makes sense only for points x lying strictly 
between an even multiple of 7 and the next odd multiple of z. 
On the other hand its alleged derivative makes sense for all points x 
(except for an infinite value at even multiples of 7). 


y = log sin x y = log log x 
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Similarly y = log log x makes sense only for x > 1 whereas its 
alleged derivative makes sense for any x >0. Finally the function 
y = log log sin x has no graph at all because sin x < 1 and therefore 
log sin x <0. Whatever the formula involving y=log log sin x 
means, it is certainly not a piece of concrete mathematics. 

It may seem artificial to consider such a bizarre function, but 
the same kind of alarming situation can arise from the simplest 
differential equations. 

What is wrong with the following argument? ‘Since 


d 1 
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the solution of the equation dy/dx = 1/x is y = log x.’ 
There are two mistakes. Firstly inspection shows that equally well 


d 1 
ae (log (— x)) = ¥ 


so that there is another candidate y= log (— x) for the solution. 
Secondly either solution may be modified by a constant without 
affecting the derivative. Therefore any of the functions 


y=a+logx 
y=b+ log (—x) 


(where a, b are real numbers) are solutions of the differential equation 
dy/dx = 1/x. This result clearly contradicts the statement, which is 
commonly made, that if (d/dx)( f(x)) = (d/dx)(g(x)) then there is a 
real number c such that f(x)=g(x)+c. The reason is that the 
statement is false unless more is said about the precise nature of 
the functions y=/(x) and y = g(x). It is not enough that they are 
represented by formulae; as we have seen in this area abstract 
formulae, however impressive, can be meaningless. 

Let us now get away from abstract manipulations of formulae, 
and consider the equation dy/dx = 1/x from a concrete point of view. 
The equation is an instruction to find functions y=f(x) whose 
graphs have slope 1/x at the point (x, f(x)). It is necessary to exclude 
the point x =0, since here 1/x is undefined and so the equation 
says nothing. At all other points the slope 1/x may be represented 
by a non-vertical direction. The diagram of slopes is symmetrical 
under reflection in the vertical axis. It is clear intuitively that the 
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region x > 0 can be filled by curves with the required slopes; these 
are in fact the graphs of the functions y = a + log x. A check shows 
that exactly one such graph passes through each point (x, y) with 
x>0. Similarly the curves filling the left-hand region x<0 are the 
graphs of the functions y=b+log (—x). Therefore the correct 
solution to the equation dy/dx = 1/x is 


y=a+tlogx, x>0 
y=b+log(-x), x<0 


where a, b are real numbers (sometimes called arbitrary constants; 
we prefer to avoid the use of this phrase because it is commonly 
asserted that if a differential equation involves dy/dx but no higher 
derivatives then its solution must contain only one arbitrary con- 
stant — the above example shows that this statement is false). The 
diagram shows that the differential equation dy/dx = 1/x does have 
solutions which fill up the two regions x >0 and x <0 in which 
the equation makes sense; however the formulae needed in the two 
regions are quite distinct. It is therefore necessary to specify a 
function, not only by a formula, but also by adding a precise state- 
ment of the values of x for which the formula holds. 


INTRODUCTION 5 


yim b 
+ log (-x) 


The aim of Chapter 1 is simply to introduce the minimum amount 
of language necessary to enable such precise statements to be made. 
In Chapter 2 a large number of examples are discussed from the 
commonsense viewpoint adopted above for the equation dy/dx = 1/x; 
in each example the method is first to draw slopes illustrating what 
the equation means, then to guess a formula for a solution in each 
region where the equation makes sense, and finally to check that 
there is a solution through each point of the region. The more 
formal discussion begins in Chapter 3. 

The reader who, as a matter of principle, reads only the intro- 
duction of any book, may like to amuse himself by considering the 
following examples, which I owe to Ronald Brown. Here and 
throughout the book, »/x denotes the positive square root of a 
real number x > 0. 


1 What is wrong with the following examination question? 
Find the least value of the function y such that dy/dx = x — (1/x) 
and y=1 when x=1. 


2 It is often said that the general solution of the equation 
dy/dx = (1 — y?) is y=sin (a+x). This is false since for 
this it is not always true that dy/dx > 0. Make a correct state- 
ment. 
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1 
2 
Why not attempt to evaluate | (sin :) dx by substituting 
-—1 ke 


x= 1/u? 


Differentiate sin~! (2+ x?) and +/(1 — x?) + \/(x2— 1). Com- 
ment. 


An A-level question asks for the general solution of dy/dx = y/x. 
Show why it is not y= ax but 


y= ax, x>0 
y=bx, x<0 
where a, b are real numbers. 


Find a solution of dy/dx = 1 + 2(y/x) which has a minimum at 
x =1 and a maximum at x= — }. 


CHAPTER ONE 


Differentiable 
functions 


We take for granted the existence of the real numbers, with all their 
usual properties, Individual real numbers may be denoted by symbols 
like 0, 1, 2, 1°33..., 4, 7 or by symbols like t, x, y, x1, x2,.... 
We do not regard ‘infinity’ as a real number, nor do we allow 
symbols like t, x, y to denote complex values unless this is explicitly 
stated. 

In practice it is often preferable to think not in terms of algebraic 
formulae but in terms of geometric pictures. In order to do so, 
consider the set R of ail real numbers, and the set R2 of all pairs 
of real numbers. We think of R as an infinite line, and of a particular 
real number x; as a point on the line. 


ee i pee Ee eee 
In the same way we think of R? as a plane, and of a particular 
Y 
Up 


x-coordinate 
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pair (x1, yi) of real numbers as a point P on the plane. We call x; 
the x-coordinate and yi the y-coordinate of the point P. 

Some regions ¢” in R? act as graphs determining yi uniquely in 
terms of x1. The condition for this is that e? should meet each 
vertical line in not more than one point. 


1.1 Definition 


A region ef in R2 is the graph of a function if no two points in o/ 
have the same x-coordinate. 


1.2 Examples 


We use two slightly different notations to specify regions in R?. 
For example e/ = {(x, y):x2 + y? < 1} means that e” consists of all 
points (x, y) whose coordinates satisfy the inequality x? + y? <1. 
Similarly o” = {(x, y):x2+y2=1} means that oe consists of all 
points (x, y) whose coordinates satisfy x? + y2 = 1. In this notation 
we write of = {(x, y):some relation between x and y}. The other 
notation specifies both coordinates in terms of a parameter. Thus 
of = {(t?, t):t © R} means that e” consists of all points (¢?, f) where 
t is an arbitrary real number. In fact none of these three examples 
are graphs of functions, since in each case there are distinct points 
in e with the same x-coordinate. 


S={(x,y)ix2*+y2<1} L={(x, y):x?*+y?2=1} S = {(?, t):t € R} 


In each of the following examples, however, 7” is the graph of a 
function. 

It is clear from these examples, and also from the discussion in 
the Introduction, that it is important to be precise about the values 
of x for which a given function makes sense. 


SF ={(t,t):t € R} S={(t,t):-1<t<1} 


S = {(x, y):x? + y? = 1 and y > 0} S = {(x, y)iy =x} 


S = {(t3,t):t € R} S ={(x, y):y = 19% digit in 
decimal expansion of x} 
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The values of x for which the function is defined are said to 
form the domain of the function. This is the content of: 


1.3 Definition 


Let oc be the graph of a function. The domain D of the function is 
the set of all real numbers which occur as x-coordinates. 


1.4 Examples 


of = {(x, y):x2+ y2=1 and y > 0} is the graph of a function with 
domain — 1 < x < 1. Note that this graph could also be described in 
the form {(x, (1 — x2)):-—1l<x<]}. 

o& = {(t3, t):t € R} is the graph of a function with domain R. It 
could also be described in the form {(x, x1/3):x € R}. 

These examples illustrate the fact that the graph of a function 
with domain 2 can always be described in the form 


SF = (x, f(n)):x € 9}. 


It is natural to think of f as a rule which associates to each point 
x € Da real number f(x), and to speak of the function f. 


xt>f(x) Domain 2 
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We now have two ways of describing a function. As a graph: this 
leads to the common notation y=f(x), x €@. As a rule which 
associates a real number f(x) to each point x € Z: this leads to the 
less familiar notation x(x), x € 2. The use of the special arrow 
++ is to avoid confusion with other contexts (e.g. meaning ‘tends 
to’). These two descriptions are illustrated together: for some pur- 
poses the idea of a graph y=f(x) is more convenient, for other 
purposes the idea of a rule x++/(x) is preferable. It will often be 
the case that f(x) is specified by an algebraic formula (for example 
J (x) = x*, f(x) = x), or that fis given a particular name (for example 
f(x) = sin x, f(x) = log x, f(x) = exp x). 


1.5 Examples 


A linear function has a graph of the form {(x, xb):x € R} for some 
real number b. We speak of the function y= xb or x+»xb. Note 
that under a linear function 0++0. An affine function has a graph 
of the form {(x, a+ xb):x € R} for some real numbers a, b. We 
speak of the function y=a+xb or xt>a+xb. If yo=a+xob the 
graph can also be written in the form {(x, yo +(x —xo)b):x € R} 
or y — yo = (x — Xo)b. In both these examples the real number b is 
called the s/ope of the function. 


Y—Yo = (X—X_)b 


We recall that certain functions can be differentiated or integrated. 
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1.6 Differentiation 


Certain functions x++/(x), x € D have a derivative xt>f'(x), x ED. 
The real number b = f'(xo) has the following significance. It is the 
slope of the affine function x++/(xo) + (x — x0)b which gives the 
closest approximation to x+~>/f(x) near xo. If this approximation 
exists for all x9 €@ then the function x++f(x) is said to be 
differentiable. 


1.7 Remarks 


To make the above description of differentiation into a precise 
definition requires a precise explanation of the words ‘closest 
approximation’ and ‘near’ in 1.6. This requires the concept of a 
continuous function as given for instance in Moss—Roberts, Chapter 
2 (especially 2.1 and 2.4). The geometric idea behind the definition 
of differentiation is that if xt-+/(x) is differentiable then each point 
(xo, f(xo)) of the graph has a non-vertical tangent. Every non-vertical 
line through (xo, f(xo)) is the graph of an affine function 


xt->f (xo) + (x — xo)b 


for some real number 6. Among these the tangent is the line giving 
the closest approximation to f(x). 


y =f(Xo)+(x—Xo)b 


Note that, if the graph of a function xt->/(x) has a vertical tangent 
at (xo, f(xo)) for some xo € Z, then f is not differentiable. In this 
case the tangent is not the graph of an affine function. 
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differentiable not differentiable 


not differentiable not differentiable 


1.8 Integration 


A function x+-+ F(x), x € @ such that F’(x) = f(x) for all x € FP is 
called an integral of the function f. If such an F exists we say that 
the function x+>f(x) or y=f(x) is integrable. 

To every method of denoting the function x+~+/(x) there corre- 
sponds a notation for differentiation and integration. Thus we may 
write y= f(x) and dy/dx =f'(x). It is also common to write Df or 
df|dx for f’. A differential equation arises typically when a relationship 
is given between y and dy/dx, or equivalently, between f(x) and 
f'(x). A function x++/(x) which satisfies this relationship is called 
a solution of the differential equation. 
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If the original equation is given only for certain values of x and y, 
for example for all points (x, y) in some region oe, then the graph 
of any solution will be contained in e%. Suppose that o” is a region 
of the form {(x, y):x € D} and that the differential equation specifies 
f(x) for all x € Z. Then any solution must have a domain contained 
in Z, and must moreover be differentiable, since otherwise f’(x) 
would not exist for all x e 2. However, the fact that the function 
xt>f(x), x €QD is differentiable implies no statement whatsoever 
about the behaviour of functions given by similar formulae out- 
side 2. 

For example consider the equation dy/dx=y/x. Here f’(x) 
is specified only in the region {(x, y):x £0}, and the function 


y=ax, x>10 
y = bx, x<0 


is a solution. The equation x(dy/dx) =y is slightly different: now 
x =0 implies y = 0, so that there is a solution with domain R 


y=ax, x0 
y=0, 5 a 
Vi=— (Bx, x <0; 


This solution is not differentiable at x = 0 unless a = b; in accordance 
with the fact that the equation does not specify dy/dx along x =0. 
In both these examples it is not permissible to conclude from the 
equation that a= b. 


1.9 Example 
Consider the equivalent equations 


r@=fe) or & 


dx 
The equation is given without restrictions on x, y; that is the relation 
holds for all (x, y)¢R2. Any solution must be a differentiable 
function x > f(x). A solution with graph containing the point 
(Xo, Yo) must have slope yo there. The required slopes can be illus- 
trated on a diagram. 

Clearly f(x) = 0 is one solution. It is plausible from the diagram, 
but not obvious, that there is a pattern of curves with the required 
slopes, and that each such curve is a solution. It is also plausible 
that there is a unique such solution through each point (xo, yo). 
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1.10 Assumption 


We assume that the equation dy/dx=y has precisely one solution 
xt+-+f(x) through each point (xo, yo). 

This assumption implies the existence of certain differentiable 
functions, and can be proved using theorems on continuous functions, 
as for instance in Moss—Roberts, Chapter 4 (especially 4.5). For 
example the solution through (0, 1) has the graph {(x, exp x):x € R} 
and in fact this can be taken as the definition of the function 
xt exp x. If on the other hand some other construction of exp 
is given, for example in terms of power series, then we could use 
the construction to prove assumption 1.10. The same graph through 
(0, 1) can also be written in the form {(log y, y):y > 0} and thus 
defines the function y+> log y. 

The usual properties of exp and log can be deduced from assump- 
tion 1.10 and the elementary properties of differentiation. Fix real 
numbers 5 and B, and compare the expressions 


y =exp (x + 5) y=Bexpx 
dy _ dy _ 
de OP +5) Fe XP * 


Therefore y=exp (x +b) is a 
solution of dy/dx=y, and by 
1.10 the unique solution 
through (0, exp 5). 


Therefore y=B exp x is a 
solution of dy/dx =y, and by 
1.10 the unique solution 
through (0, B). 


It follows that if B= exp b then B exp x = exp (b+ x) for all x ER. 
We deduce that exp (a + b) = exp a.exp b for all a, b € R. Similarly 
log ab = log a + log b for all a, b > 0. 

If n is a positive integer exp (n)=exp (1 +--+ +1) and hence 
exp (m) = e", where e¢ = exp (1). This suggests that we define e”, even 
when x is not an integer, by the equation e* = exp (x). 


1.11 Example 
Consider the equivalent equations 
S'(x)=0 or dy/dx=0. 


The equation is given without restrictions on x, y; that is the relation 
holds for all (x, y)¢R2. Any solution must be a differentiable 
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function x'->f(x) with domain R. The required slopes can be 
illustrated on a diagram. 


Clearly for any real number c there is a solution y = c. Similarly, 
if J denotes the interval a < x <b the equation 


t'(x) =0, xe 


has solutions f(x) = c v.ith domain /. It is plausible from the diagram, 
but not obvious, that these are the only differentiable functions with 
domain J which satisfy the equation. 


1,12 Assumption 


We assume that if xt->f(x) is a differentiable function with domain 
a<x<bandf"(x)=0 for all a< x <b, then there is a real number c 
such that f is the constant function f(x) = c. 

This assumption can be proved using theorems on differentiable 
functions, as for instance in Moss—Roberts, Chapter 3 (especially 
3.4). It implies the uniqueness of certain differentiable functions. 
Suppose x+->/(x) and x+-> g(x) are two differentiable functions with 
domain a < x < b such that f(x) = g’(x). Then the function xi-> A(x) 
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defined by h(x) = f(x) — g(x) has domain a < x < b and hA’(x) = 0 for 
all a< x <b. Therefore by 1.12 there is a real number c such that 


S(p=e(x)+¢, a<x<b. 


Note that if the domain of x++/(x) and xt-g(x) consisted of 
several disjoint intervals then the assumption would imply 


F(x) = g(x) + (x) 


where x}->c(x) is a function which is constant on each interval. 
This is the situation in the example considered in the introduction, 
where the domain consists of two intervals x <0 and x>0, and 
any two solutions of the equation 


r@=s, x#0, 


differ by a function 
CO) =a; x>0, 
c(x) = 5, x<0. 


It is necessary to use such functions x'-c(x) in order to make 
correct the traditional rules about ‘arbitrary constants’ mentioned 
in the Introduction. 

In the sequel we make use without comment of the elementary 
rules for differentiation (in particular how to differentiate the sum 
of two functions, the product of two functions, and a function of a 
function) which should be familiar from any school treatment of the 
subject. These rules are set out explicitly for instance in Moss- 
Roberts, Chapter 2 (especially 2.5). The other important properties 
used in the sequel are those summarized in assumptions 1.10 and 
1.12. Any other property which is needed, will be mentioned as it 
arises. 


Exercises 


1 Make use of the usual rules for differentiation to find derivatives 
for the functions 1/x, log x, sin x, log +/x, log log x, log sin x, 
log log sin x. 
In each case make a careful statement of the domain of the 
function, and the domain of its derivative. 
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2 Find integrals for the following functions with domains as 


indicated: 
as 
/x 


(i 


(i) 


(iii) cos x 


COs x 


(vi) 


sin x log sir. x 


a> 'D: 


x0, 
all x, 


x #nz for integer n, 


VS <1 or ix 1 


2nm < x < (2n + 1)m for integer n. 


3 Sketch the graphs of the functions 


Xx, xeER, 
xt>(/x)?, x20, 
xt> V(x”), xeER, 


Xt>- > x #0, 


x 


(the four diagrams obtained should all be different). 


CHAPTER TWO 


Examples of 
differential 
equations 


Frequently the functions which occur in a differential equation are 
functions of time. For this reason we change notations slightly, and 
consider graphs {(t, f(t)):¢ € D} of functions x=/(t) or tr>f(t) 
with domain Y. Suppose some relationship between ft, f(t) and 
f'(t) is given; in what circumstances do we expect the existence of a 
function t+~/(t) satisfying the relationship, and how large is the 
domain of the function? It is instructive to consider more examples 
like 1.9. In the first few examples the equation specifies /’(¢) in a 
certain region of the (r, x)-plane. We adopt the following procedure: 
firstly draw the lines of slope on a diagram, secondly sketch the 
curves with the given lines as tangents (the so-called solution curves), 
and thirdly use one of the curves to sketch the graph of a typical 
solution of the equation. 

In many cases the shape of the curves suggests immediately how 
to guess the equation x =/(t) of a solution. Once a guess has been 
made it is usually easy to check whether the function x = /(f) is in 
fact a solution, and whether there is a solution through each point 
(t, x). The discussion of explicit methods for deducing the equation 
x =/f(t) of a solution is postponed until Chapter 3. 


2.1 Example 
f(t) =1, also written dx/dt = 1. 


The equation asserts that the slope at each point is 1. The diagram 
suggests that every solution has the form x=f+c, where c is a 
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real number, and that there is a unique solution with domain R 
through each point. In fact both these statements follow from 
assumption 1.12. 


Slope lines, solution curves and typical solution of f’(t)=1 


2.2 Example 
S(t) =2t, also written dx/dt = 21. 


In this case there is again a unique solution with domain R through 
each point. Clearly x=7? satisfies the equation; therefore by 
assumption 1.12 every solution with domain R has the form 
x =12+c where c is a real number, and there is one such curve 
through each point (t, x). 


2.3 Examples 

Consider the differential equation 
I'®)=1, t>0 
f@M=-1, t<0. 


In this case f’(1) is undefined at t=0, so that we expect solutions 
with domain R* = {t:t #0}. In the region t>0 there is a unique 
solution x=t+a, t>0O through each point; in the region t<0 
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there is a unique solution x = —t+5, t<0 through each point. 
However, a typical solution with domain R* has the form 
x=t+a, t>0 


x=-—t+5b, t<0 
where a, 5 are real numbers. Again these statements follow from 
assumption 1.12. 


LEDS. 
AWAY 377 
peeves 47 


The situation is similar to the equation f’(t) = 1/t, t 4 0 discussed 

in the introduction. Here a typical solution has the form 
x=logt+a, t>0 
x=log(—14)+4, t<0 

where a, b are real numbers. 

Notice that the equation f’(t) = t/t, t 4 0 is not the same as example 
2.1, since the slope is undefined at t= 0. A typical solution has the 
form 

x=t+a, £>0 

x=t+b, t<0. 
This distinction can be important in applications, where an expres- 
sion like t/t occurs in the middle of a calculation and is cancelled 
unwittingly. 


2.4 Example 
S(t) =f(t) — 2, or dx/dt = x —2. 
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The situation is almost the same as that in 1.9. By assumption 1.10 
every solution has the form x = 2+ ce‘ where c is a real number, 
and there is a unique solution through each point (t, x). 


2.5 Example 
fH =2Vf/(, or dx/dt =2/x. 


U 
/ 


Here, and in the sequel, »/ denotes positive square root. The equation 
implies that x > 0. In the region x >0 there is a unique solution 
through each point. The function x =(t—c)?, t>c satisfies the 
equation, and has domain t > c for some real number c. However, 
in the region x > 0 there are solutions of the form 

x=(t—c)?, tC 

x=0, t<e 
with domain R, as well as the solution x =0. Note that through 
any point on the line x = 0 there pass an infinite number of solutions. 


The reader may suspect, correctly, that this is connected with the 
fact that at x = 0 the function x+~2+/x is not differentiable. 


2.6 Example 
t+f(t)f'(t) =0, or t+ x(dx/dt) =0 


fe 
x=-(b-1) 


In this case the slope is undefined when x = 0. The diagram suggests 
that curves t? + x2 =c will satisfy the equation for any real number 
c > 0. This is in fact the case because (d/dt)(t? + x?) = 2[t + x(dx/dt)]. 
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Thus typical solutions are x = \/(a—t?) with domain {t:t? < a}, 
x=0 with domain {t:t=0}, and x= —4+/(6—1#2) with domain 
{t:t2 <b}, where a, b are positive real numbers. There is a unique 
solution through each point (t, x) with x £0. 


2.7 Example 
tf'(t) +f(t) =0, or x + t(dx/dt) = 0. 


Se - <> a mG a eg 
rt 
ipa, b>0 a<0 
The slope is undefined when ¢ = 0. The diagram suggests that curves 
tx = c will satisfy the equation for any real number c. This is in fact 
the case because (d/dt)tx = x + t(dx/dt). Through each point of the 


region t < 0 there is a unique solution of the form x = /t with domain 
t<0. Typical solutions with domain R have the form 


x=-, t>0 
x= 0, t=0 
t<0 


where a, b are real numbers. 


2.8 Example 
tf'(t)=3f(t), or t(dx/dt) = 3x. 
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The slope is undefined when t = 0. The diagram suggests that curves 
x = ct? will satisfy the equation for any real number c. This is in 
fact the case because t(d/dt)(ct®) = 3ct3. Through each point of the 
region ¢<0 there is a unique solution of the form x= bt? with 
domain t <0. Typical solutions with domain R have the form 

x= ats, t>0 

x=0, t=0 

x= bt3, t<0 
where a, 6 are real numbers. 


2.9 Example 

f'O=[2t+/OJ/[t —2f(H), or dx/dt = (2t + x)/(t — 2x). 

The slope is undefined along t=2x, zero along x= —2t, and 
1 along t= — 3x. Other slopes are 2 along x=0, and —4 along 
t =0. The equations (d/dt) (x* + t?)=2x(dx/dt) + 2t=2(x? + t?)/(t—2x) 
imply that as ¢ increases the distance from (t,x) to (0,0) increases 


x=-2t 


t=0 


dx 2t+x 


Slope lines and solution curves for 


a” t= 


v 
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or decreases according as t>2x or t< 2x. Therefore the curves spiral 
in to the origin in a clockwise direction as shown. 

Typical solutions are given by fragments of spirals chosen so as 
to be graphs of functions (as in definition 1.1). In this case we make 
no attempt to guess a formula for x in terms of t. The reader may 
suspect, correctly, that to do so conveniently requires polar co- 
ordinates or complex numbers. 


2.10 Example 
t(2x3 — t3)(dx/dt) + x(2t3 — x3) =0. 
1=0 


7s: 
x= 4/2 


sign of slope 


N'B 
@ 


solution curves 
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The slope is undefined along t=0 and t= x4/2, zero along x =0 
and x = 14/2, and —1 along x=t and x= —t. 


2.11 Examples 


Examples 2.9 and 2.10 illustrate the fact that a sketch of the solution 
curves may well give useful and detailed information, even though 
it is not possible easily to write down formulae for the solution. 
It might be thought that every differential equation decomposes 
regions of the (t, x)-plane into curves which hardly ever cross each 
other. This is true for sufficiently simple equations, but not for the 
more complicated kinds of equation which occur in the following 
examples. 

Consider the equation (dx/dt)? = t. It implies first that t > 0, and 
secondly that at the point (t, x) there are two possible slopes +/t 
and — 4/t. The corresponding diagram of solution curves shows 
two curves through each point (ft, x), t > 0. Notice that this pattern 


x 


can be got by superimposing the solution curves for the equation 
dx/dt = +/t and the equation dx/dt = — +/t. 

A similar situation arises from the equation (dx/dt)? = 4x. The 
equation implies that x>0 and dx/dt= +2,/x. In the region 
x>0O the solutions to dx/dt=2,/x (compare example 2.5) and 
dx/dt = —2+/x are superimposed. 

Differential equations involving (dx/dt)? but no higher powers 
are said to be of the second degree. Such equations frequently 
determine a region of the (¢, x)-plane in which there are no solutions, 
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and a region in which there are precisely two solutions through 
each point (obtained by superimposing solutions of two equations 
of first degree). 


2.12 Examples 


Consider the equation (d?x/dt?) =0, or f"(t) =0. 
This equation involves the second derivative of ti-»/(t), and is 
therefore said to be of second order. It is satisfied by any affine 
function 

x=a+t+tb 


where a, 6 are real numbers. There is an infinite collection of solution 
curves through each point (tf, x), since every non-vertical line in the 
(t, x)-plane is the graph of a solution, and hence there is no con- 
venient diagram of solution curves. 

A better approach to this equation is to substitute y = dx/dt, and 
to write the equation 


Now a solution can be regarded as a pair of functions ti x(t), y(t) 
and represented by a curve in the (x, y)-plane. Clearly the solution 
curves have the form y=a; the equation dx/dt = y shows that x 
is increasing if a>0, constant if a=0, and decreasing if a <0. 
Solutions are illustrated in the diagram overleaf: points on opposite 
sides of the line of rest points move in opposite directions. 
This method of replacing a second-order equation by two first- 
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order equations involving t, x, y, dx/dt, dy/dt is adopted in Chapter 
4. In Chapter 3 we restrict attention to first-order equations. 


Exercises 


1 Sketch solution curves of the differential equations 


dx 
ME 
at 
aX 
came 
dx 

t— =x. 
dt 7 


2 Let | ¢| denote the modulus of ¢, and 4/ positive square root. 
Explain the differences between the equations 


3 ees 2) ai dx _ ee dx _ 
(7) =i, (4) =|, anv" i vt, aoe ls) 


and sketch solution curves for each (the five diagrams obtained 
should all be different). 


3 Consider the differential equation 


Prove that there are no solutions through points in the region 
{(t, x); x? <4t}. What can be said about the solution curves 
in the rest of the (t, x)-plane? 


CHAPTER THREE 


Solution of 
first-order 
equations 


The method used to solve the differential equations of the previous 
chapter was essentially to guess the formula for a solution and then 
to check that it works. Often however it is possible to deduce the 
form of a solution by using elementary integration. This is particu- 
larly the case for equations of the first order, that is, involving 
t, f(t) but no higher derivatives. We make use of the usual rules for 
integration (including substitution and integration by parts) as well 
as the standard properties of trigonometric and exponential func- 
tions. A careful discussion of all these matters is given in Moss— 
Roberts, Chapter 4 (especially 4.4, 4.5, 4.6). 


3.1 Equations of the form dx/dt = g(t) 


Examples 2.1-2.3 are of this form, in which dx/dt depends only 
on ¢t and not on x. The examples illustrate that the domain of the 
function g may not be the whole line R, and that to obtain a solution 
given by a single formula it is necessary to restrict to an interval 
p<t<q in which g is well behaved. 


We adopt the convention, when referring to an interval p < t <q, 
that the interval may in fact be unbounded at one end (p<t or 
t <q) or at both ends (the whole line R); however, we prefer not 
to use picturesque symbols like ‘¢ = + 0” to describe this situation. 
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Theorem. Let g be an integrable function with domain p<t<q. 
Then the differential equation 


o = a(t) 


dt 
has a unique solution x = f(t) through each point (to, xo) with p < to <q. 
The domain of f is the interval p<t <q. 


Proof. Since g is integrable there is, by 1.8, a function G with 
domain p<t<q such that G'(t)= g(t). Let c=xo — G(to). Then 
(t) = c + G(t) gives the required solution. If A(t) is another solution 
with A(to)= xo, and k(t)=f(t)—A(t), then k is a function with 
domain p <t<q which satisfies the equations k’(t)=0, k(to) =0. 
By assumption 1.12 this implies k(t)=0. Therefore the solution 
x =f(t) is unique. 

Remark. The lack of content in this proof is due to the fact that 
we defined integration in 1.8 as the opposite of differentiation. If 
integration were defined in some other way — for example by cal- 
culating areas or by integrating power series term by term — the 
proof would be more difficult and the theorem more significant. 
The application of this theorem depends on being able to compute 
the integral G in a specific case; we give some examples of this, 
using elementary facts about integration. 


3.2 Examples 
Let a, b be real numbers, and consider the equation 


dx 

mM at +b. 
By assumption 1.12 there is at most one function ¢}-->G(t) with 
G'(t)=at+6 and G(0)=0, so clearly it must be t++>4at? + dt. 
Therefore every solution to the equation has the form 


x= }hat?+bt+c 
where c is a real number. 
Now consider the equation 


LOD —-l<t<l. 


a y¥(i-2y 
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By assumption 1.12 there is at most one function t+»G(t) with 
G'(t) = 1/+/(1 — t?) and G(0) = 0. We use the standard notation 


1 
G(t) | yam du 


for this function. Since —1<t<1 we can write u=sin @ with 
— 42 <0 < 3m, and obtain 


sin-'¢ 


t 
1 1 : 
se Ia pl ees Ngee 6 d0=sin-! ¢. 
| nw | PO sin 
ry ry 


Here sin-! ¢ denotes the unique number @ such that sin 6 =f and 
— 4m < 6 < 4x. Thus every solution to the equation has the form 
x=c+sin-!f, —-l<t<1l 
where c is a real number. 
Consider next the rather similar equation 
eae SE 
dt W(t?-1y 
Here the domain of the function g(t) = 1/+/(t? — 1) consists of two 
distinct intervals which must be considered separately. Define 


t<-lort>l. 


cosh v = $(e” + e~”) 
sinh v = }(e” — e~”). 
The properties of exp in 1.9 and 1.10 imply that (d/dv)(cosh v) = sinh v 
and (d/dv)(sinh v)=cosh v. Moreover (cosh v)?—1=(sinh v)?. 
If u>1 there is a unique real number v >0 such that cosh v=u, 
and we write v =cosh~! uw. These facts suggest the following substi- 
tutions. 
(i) In the interval uw > 1 let w=cosh v, v>0; then 
t 1 cosh-*t 
——____—__ d = = re 
| Vu —1) lu | a cosh~! ¢ 
1 
and so every solution has the form 


x=a+cosh-!f, E> 1. 
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(ii) In the interval u< —1 let —u=cosh v, v>0; then 
t cosh-? (—t) 
| Gea) du = | a = cosh-! (— f) 
-1 0 
and so every solution has the form 


x = b—cosh-! (— 4), t<-1. 


<= 
2 


Solutions to Solutions to 
pn ae 
dt V-?#) dt V(t®?—1) 


Consider the equation dx/dt=1/t, t#0. Again the domain of 
g(t) = 1/t consists of two distinct intervals t>0 and ¢<0. By 1.10 
every solution in the region t > 0 has the form x = a + log ¢. Similarly 
every solution in the region t <0 has the form x = b + log (—?). 

The substitution t — q for t, shows immediately that every solution 
of the equation dx/dt = 1/(t —q) has the form 


x=a+t+log(t-—q), 4q<t, 
x=b+log(q—9), i< ai 
Finally consider the equation 


dx 1 


a @- Ween nie 
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The domain of g(t)=1/(p—t)(q—1t) consists of three intervals 
t<p, p<t<q, andq<t. Since 


Sean te (+.-) 
(p—iKa-t) @-—p iG. tp 
every solution has the form 


eect [log (q — t) — log (p — t)] 


1 Gs 
=¢c+—--— log ( ) fort <p, 
q—-P 4 : 


1 

x= 6 +—— flo —t)-—log (t— 
rp g (q — t) — log (t— p)] 
1 ” fo 

=b+——- lo (24) forp<t<q, 
q—P g t—p Pp q 


x=a+—— [log (4) —log ((—p)] 


=at : log (*=4) for qg <t. 
q—P A 


3.3 Equations of the form dx/dt = h(x) 


Examples 2.4-2.5 are of this form, in which dx/dt depends only 
on x and not on ¢. The examples illustrate that the domain of h 
may not be the whole line R, and that to obtain solutions given 
by a single formula it is necessary to restrict to an interval a<x<b 
in which A is well behaved. Moreover it may be necessary to restrict 
to an even smaller interval to make sure that there is a unique 
solution through each point (fo, Xo). 

We first observe that if h(c)=0 then x=c is a solution. This 
makes it reasonable to restrict attention to intervals a<x<b on 
which h(x) > 0 or h(x) < 0. 


Theorem. Let h be a function of constant sign with domaina<x<b 
(that is, either h(x) > 0 for all a < x < b, or h(x) < 0 for alla <x <b). 
If 1/h is integrable, the differential equation 


dx 

sey 7 
HO) 
has a unique solution x = f(t) through each point (to, Xo) with a < xo < b. 


The domain of f is some interval containing to. 
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Proof. Note first that by 3.1 the equation 


: ae, 
dx h(x)’ 


has a unique solution ¢t = k(x) through (fo, xo). Thus & is a function 
with domain a < x <b, and k’(x) is of constant sign. We now use 
the inverse function theorem proved in Moss—Roberts, Chapter 3 
(especially 3.5) to assert the existence of a unique function /, with 
domain an interval containing fo, such that, for all a < x <b, 


(i) x =f(t) if and only if t= k(x), and 
(ii) x =f(t—c) satisfies dx/dt=h(x) if and only if t=c + k(x) 
satisfies dt/dx =1/h(x). 
We conclude that every solution in the region a< x <b has the 
form 


a<x<b 


x=f(t—c). 


Note that in practice the formula for the inverse function f is usually 
immediate, so that the full strength of the inverse function theorem 
is not needed. 


3.4 Examples 


Consider the equation 


A comparison with the proof of 3.3 shows that 


1 


h(x) i) 


and therefore solutions of dt/dx =x in the regions x >0 or x <0 
have the form 
=c + $x? 
Therefore through each point (to, xo) with xo> 0 there is a solution 
of the form 
x = (2t — 2c) 


with domain {t € R:t> c}. 
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Consider next the equation dx/dt = }(x? — 1). There are solutions 


x =1 and x = —1 because for these values h(x) = }(x? — 1) is zero. 
A comparison with the proof of 3.3 shows that 
1 2 1 1 


Wx) &-Ila~t+l x-1l xt1 
and that therefore the solutions of dt/dx = 1/h(x) in the regions 
x < —1 or x>1 have the form 


x-l1 
t= log ——.. 
aa eee 


This equation is equivalent to e*-*=(x-—1)/(x+1), so that 
1 + ef-¢ = x(1 — et-). Through each point (fo, xo) with xo > 1 there is 
a solution of the form 


lee 1+ ae 
1—e¢ 1-—aet 


where c is a real number and e~* = a> 0. Note that the domain of 
this function is {t € R:t< — log a}. 

A similar calculation in the region —1<x<1 shows that 
t=c + log (1 — x)/(1 +x), and hence 


_l—-e*_ 1-—<ae 
l+e-«¢ 1+ aet 


is a solution with domain R for any a> 0. 

The solutions to this equation are illustrated in 4.1. 

Now consider the equation dx/dt=./(l1— x?) —l<x<l. 
There are solutions x=1 and x= —1 because for these values 
h(x) = /(1—x?) is zero. A comparison with the proof of 3.3 
shows that 


Ws) i Wr — x4) 
and that therefore the solutions of dt/dx = 1/h(x) in the region 
—1<x<1 have the form 
t=c+sin- x, —-1l<x<\l. 
This equation is equivalent to 


x =sin (t—c), c—4har<t<ct+ hr, 
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and yields solutions with domain c—}2<t<c+4m. Through 
each point (fo, Xo) with —1<xo<1 there is a unique solution. 
However, through points (to, — 1) and (to, 1) there are many solu- 
tions, for example every real number c determines a solution 


=-] t<c—}r, 
x =sin (t—c) c— tr<t<cthn, 
x=] ct+4hr<t. 


For a further example consider the equation dx/dt = 3x2/3, Here 
x?/3 denotes the unique cube root of the real number x2. There is 
a solution x=0 because for this value x2/3 is zero. Each point 
(to, Xo) in the region x >0 lies on a unique solution of the form 
x =(t—q)® with domain t>q. Each point in the region x <0 lies 
on a unique solution of the form x =(t—p)? with domain t <p. 
However if p <q there are solutions with domain R of the form 


(t—p)8 t<p 


tg) q<t 


and so uniqueness fails for points on x = 0. 


3.5 Equations reducible to the form 3.1 or 3.3 


The first-order equations considered in: 3.1 and 3.3 are extremely 
special. A more typical equation would have the form 


dx 
dt =f(t, x), (t, x) E f 
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where ef is a region in the plane R? and (ft, x)~>/(t, x) denotes a 
function which associates, to each point (t, x) of ce”, a point f(t, x) 
of R. Occasionally, however, it is possible by cunning manipulation 
to reduce the above equation to one of the form 3.1 (in which f(t, x) 
does not depend on x) or of the form 3.3 (in which f(t, x) does not 
depend on f). We give some examples. 

Consider an equation of the form 


& = g(H(x) 


where g is a function with domain p <t<gq, and h is a function 
with domain a < x < b. If there are solutions for the equations 


=. =s @(f); p<t<q,asin3.1 


= =h(x) a<x<b,asin3.3 


then x = x()(t)) is a solution of the original equation inside the 
rectangle p< t<q, a<x<)b. For instance the equation 


dx 

~* =2 

mr {x 
can be solved in this way. The equations 

dy 

oF 2 

dt ' 

dx =X 

dy 


have solutions y=?f2+c and x=be” respectively. Therefore a 
solution to the original equation dx/dt = 2tx is 


x = bet*t¢ = (be*)et® = aet* 


where a ER. Equations of this type are sometimes said to have 
variables separable. 


Consider now an equation of the form 


dx 
at = g(u) 
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where u=x/t and g is a function with domain a<u<b. This 
equation is therefore defined for all points (t, x) in the region strictly 
between the lines x = at and x = bt. Note that (0, 0) is excluded, so 
that the region consists of two distinct parts. If x = ut we have 


and hence an equation 


du 1 
dt = 7 (g(u) — u) 


GA 


Solutions to 
2d PtH? 
dt t? 


which is of the ‘variables separable’ type (note that 0, so that 
1/t is well defined, throughout the region in question). For example 
the equation 
pela 
dt r 
is of this type, since x = ut gives 
2t i +2u=u?+1 
dt 
du 1 
— =— (u—1)?. 
dt 2t ae 
The equation dy/dt = 1/2t has solutions of the form 


y=hlog|t|+e 
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in the regions t>0 and t<0. The equation du/dy =(u— 1)? has 
a solution u = 1, as well as solutions u= 1—1/(y+q). Every point 
(xo, to) with to #0 lies on a solution of the original equation 
given by a formula of the following type (we set a = 2(c+q)). 


Sites ty ace lee teu, with domain 0 < t < e~@. 
a+logt 

If xo =to>0,x=t with domain 0 < ¢. 

Ifto>xo>0,x=t ee with domain e~¢ < ¢. 
a+logt 

2t ‘ ‘ 

If xo < to < 0, x = t -—_—_———._ with domain —e-* < ¢ <0. 
a+ log (—1?) 

If xo=to<0,x=t with domain t < 0. 

If to <X0< 0, Ket with domain t<—e%, 


The reader should use these formulae to make an accurate version 
of the rough sketch of solutions on the opposite page. Equations 
of this type are said to be homogeneous, but this is only one of the 
many distinct meanings of the word ‘homogeneous’ in connection 
with differential equations. 


3.6 Exact equations 


As in 3.5 we consider a function (t, x)~/(t, x) which associates, 
to each point (t, x) € 0%, a point f(t, x)eR. We use without 
proof the fact that certain such functions are differentiable, and 
yield ‘partial derivatives’ = and MA . Thus th bs (t, Xo) 
is defined to be the derivative of tt-~f(t, xo), for fixed xo. Similarly 


Xb = (to, x) is the derivative of x++f(to, x), for fixed fo. 


If x =g(t) then f(t, x) can be regarded as a function of ¢ with 
derivative 


d _ Of , of dx 
7 Se =35 4 os Ht 


42 ELEMENTARY DIFFERENTIAL EQUATIONS 


This fact can often be exploited as follows. Consider a differential 
equation of the form 


We ae o = h(t). 
If it is possible to find a function (t, x)t>/(t, x) such that 
: Ci imcikeh rand 2 tt, i) 0 aaa eanation can be 
written 


d 
LGD) = HO 


and solved by the method of 3.1. We give two examples. Consider 
the equation 


(pt + qx) + (qt + sx) # =0 
where p, g, s are real numbers. It can be written in the form 
(4 pt? + gtx + 4 sx?) =0 


and therefore there are solution curves of the form 
pt? + 2gtx + sx%=c 

for any real number c. Fragments of these curves are graphs of 
solutions x = g(t) of the original equation. 

Note that an attempt to apply the same method to the equation 

(pt + qx) + (rt + sx) = =0 

will fail if r#q. This illustrates the fact that it is only in certain 
lucky situations that the above method can be used. 

For another example consider the equation 


2x dx +x2 cos t= 2t e-sint, 
dt 


It can be written in the form 


x? esint cos t+ 2xesin t oa 2t 


‘ (x? esin t) = 24 
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and therefore there are solution curves of the form 
xP ee (ft? +c) ee! 

for any real number c. The fragments of these curves given by 

x =e7t sin t 4/(¢2 + a), 12> —a, 

x= —e taint ,/(712+5), 122-5, 
are solutions to the original equation. The method used in this 
example consisted of multiplying through by a non-zero ‘integrating 
factor’ e*!2¢, designed to make the equation exact. There is one 


class of differential equations for which this method always works; 
these are the so-called linear equations. 


3.7 Linear equations 


A first-order equation is /inear if it can be written in the form 


é +x g(t) =hA(t) 

where g, A are functions with domain p < t <q. We wish to investi- 
gate under what circumstances there exists a unique solution through 
each point (to, xo) with p < to <q. 

We first assume g integrable. Then there is a unique function G 
with domain p<t<q such that G’(t)=g(t) and G(to)=0. Since 
e@® is non-zero for all p<t<q, the differential equation is not 
changed by multiplying through by the integrating factor e@. 
Therefore the original equation is equivalent to 


t 


4 (£6000) = h(t) 80, 


We now assume he® integrable. Then there is a unique function 
k with domain p<t<q such that k’(t)=A(t)e® and k(to) =0. 
By 3.1 there is a unique solution through (to, xo) of the form 

x e@) = x9 + K(t) 
x =e-F (xo + K(t)). 


The solution is a function with domain p <t <q. 
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Remarks. The usual notation for G and k in terms of integrals is 


t 
G)={ gu) du, 
te 


t 
k(t) = f Gu) hiv) du. 
te 
The most important special case is when g is constant. Then the 
equation has the form 


dx 
a + xa=h(t) 


for some real number a. Every solution can be written in the form 
t 
x=eu (« + i e% h(u) du 
te 


where c is a real number; this solution passes through (fo, xo) if 
c = xpe%o, 

The theory of 3.1, 3.3, 3.5 and 3.7 may raise the following 
question. Clearly it is of interest to know whether a given differential 
equation has a solution through a given point (to, xo). But why 
is it of interest to know whether or not the solution is unique? 
There are two main reasons. Firstly, in applications where x is 
a variable depending on time ¢, it is important to know whether 
or not the differential equation and the value xo at time fo deter- 
mine x uniquely for all t>to. Secondly, differential equations are 
often solved in practice by programming a computer to make 
successive approximations to the solution; if the solution is not 
unique the computer may have a nervous breakdown trying to 
find it. 


3.8 Equations reducible to linear form 


Occasionally an equation which is not linear can be reduced to a 
linear equation by a suitable trick. For example consider the 
‘Bernoulli equation’ 


. +xg(t)=x"h(t), x0. 
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Let y=x1-", which makes sense because x #0. Then 


dy a ern dx at, i rn pre —n 
ap 7b —mdan® = (1 — mate) — (1 — nxt a(t) 


so that y is a solution of the differential equation 
d 
7 Dy) = — (a DAL) 
which is linear. 
For another example consider the equation 
dx 
at 
Let ¢ = e“, which makes sense because ¢ > 0. Then 
dy dt & 
du dt du dt 


so that x is a solution of the differential equation 


+x g(t) = A(t), t>0. 


s + x g(e”) = h(e“) 


which is linear. 

In both these examples the substitution which makes possible 
the reduction to a linear equation depends crucially on the restric- 
tions imposed (x # 0 in the first example; ¢ > 0 in the second). 


3.9 Examples 
Consider the equation 


= < : x'> 0: 

This arises in economics, where c is the total cost of an output x, 
dc/dx is the so-called marginal cost, and c/x is the so-called average 
cost. This equation is homogeneous. The substitution c = ux gives 
du/dx =0 and hence every solution has the form u=constant. It 
follows that if the marginal cost equals average cost at every output 
then the average cost is constant. 

Consider the equation L(dx/dt) + xR = v(t). This arises from an 
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electric circuit with inductance L > 0, resistance R > 0, and voltage 
v(t) at time t. The solution x(t) is then the current at time ¢. This 
equation is linear. The method of 3.7 gives, writing a= R/L, 


dx 1 

at ee ee v(t), 

d t a, t 
Eee =r v(t) ew, 


t 
xet=c+ | v(u) e@ du. 
0 


Suppose for example that v(t) is a constant input E started at time 
t =0 and switched off at time ¢ = t1. There are then two cases. 


For 0<t< 4% choose the solution with x =0 at t=0. This cor- 
responds to choosing c=0 and v(u) = E. Therefore 


t 
E E 
at — au Pan at _. 
xe L | et dy - (e 1) 
0 

and hence 

E Ls 

a ae Rt/L) for O< t< ty. 
For t: < ¢ choose the solution with x = (E/R)(1 — e~%:) at t= nh. 

This corresponds to choosing c=(E/R)(e%:—1) and v(u)=0. 


Therefore 


E 
x= pent —l)eRVUL fort <t, 
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1 


Exercises 


Find every solution t+->x(t) of the following differential equa- 
tions, as well as the solution through (1, 0). 


sy Es gi iy AX _ pot 
Hea? 55 1 NN 1 
(iit) a i+ Gv) a VW(i+?y 
dx 3) GE COStE 
(v) a 7 O84 (vi) Paes oe, t#nn. 


For each of the following differential equations find every 
solution t++ x(t), and state its domain. Is the solution through 
(0, 1) unique? 


ee Oe sn), OL) 
(i) or x? —3x+2, (ii) Cte bet, beER, 
sy ER ot ave ae a ee 
(iii) 7 = (x — 1)?, (iv) ae /(x?—-1), x21, 


dx Mey b 
(v) am 2/x; | x20, (vi) ae tanx, x#(n+4)7. 


Find all solutions of the differential equations 


(i) (32x — tx) + (213x? + £3x4) =0, 
(ii) (1 +2x) + (4-1) H =0, 732, 
V clea x 
(iii) ae cos P t>0, 
(iv) (2-39 “any, t>x>0, 
dx 
».* Piaitee 34 
(v) e at + 3xe3t = 21, 


(vi) (2t-+ 3x) + Bt — x) . = 12, 
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4 Solve the differential equations 


Ee ‘Beg 
(i) a tenes 


Peni bs al Tv 
(ii) a +X tant=0, Page € Sp 
tec! i : 7 7 
(iii) GX tant =4sint, <a Ste 
; dx 

(iv) et ee ea, t>0, 

dx 

(v) 5 + ix + xt =0, x>0, 
(vi) 1 4 xlogr= 2, t>0. 


5 Show how to solve an equation of the form 
dx 


7 


+x g(t) =h(t), t<0 
by a substitution t= — e%, 


6 Show that x=¢3 and x=/4 are solutions of the differential 


equation 
» d2x dx 
(fm OF x= 0, 
de 6t az + i 0 


Deduce that if p, qg, r, s are real numbers, and 


ptii+qtt t>0 
fO= 
rt3 + st4 t<0 
then x =/(t) is a solution. What restrictions are imposed on 
P, q, v, 5 if it is required that f be 
(i) twice differentiable, 
(ii) three times differentiable, 
(iii) four times differentiable ? 


CHAPTER FOUR 


Autonomous 
systems 


In the previous two chapters solutions to a differential equation 


were considered as functions f+ x(t), or as curves in the (¢, x)-plane. 
This description has certain disadvantages: 


(i) unless the function f has an especially simple form it may not 
be possible to find explicit formulae for a solution; 


(ii) such exact information may in any case not be required for 
the problem under discussion, and it might suffice to give a simpler 
description; 


(iii) a physical problem might involve two functions x, y related 
by differential equations 


dx 

dt = g(t, x, y) 
dy _ 

a = h(t, x, y) 


so that solutions must now be represented by curves in the three 
dimensional space with coordinates (t, x, y). 

The equations in (iii) may be imagined as controlling the motion 
of a particle in the (x, y)-plane. The velocity of the particle, if it 
reaches (x, y) at time t, has components dx/dt, dy/dt. In some physical 
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problems the velocity depends only on (x, y), not on the time ¢; 
that is, the direction and speed of travel depend only on the position 
(x, y) of the particle, not on the time at which it reaches that position. 
This situation corresponds to a pair of differential equations 


dx 


a oY) 
ie 
a ey) 


where g, / are functions defined in a region e&” of R2. Such a pair 
is called an autonomous system in two variables. A solution of the 
autonomous system is a pair of functions t+>(x(t), y(t)). In the 
same way, an equation 


dx 
Rie 


of the type considered in 3.3, is called an autonomous equation 
(or an autonomous system in one variable). The essential feature, 
in both cases, is that the right-hand side does not depend on ¢. 

The frequent occurrence of autonomous systems in two variables 
leads to a search for a simpler method of representing geometrically 
their solutions. First, we consider an example of the corresponding 
situation for one variable. 


4.1 Examples 

Consider the equation 
GX _ ag 
he 4(x? — 1). 


It is autonomous, because the right-hand side is independent of 1, 
and explicit solutions were obtained in 3.4. For many purposes, 
however, the following analysis would be sufficient. 

At x= +1 we have dx/dt=0, so x=1 and x= —1 are rest 
points; for x > 1 or x < —1 we have dx/dt >0, so at these points 
x increases with time; for —1<x<1 we have dx/dt<0, so at 
these points x decreases with time. The left-hand side of the diagram 
represents the information given by the explicit formula: x =1, 

=-—lor 

_1+ Ae 


ss BAG > ea i 
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obtained in 3.4. The right-hand side of the diagram represents 
the information obtained in the cruder analysis above. Both diagrams 
display equally the most important facts about the equation, namely 
that x =1 is an unstable solution (points near x = 1 move away 
from 1 as ¢ increases), while x = —1 is a stable solution (points 
near x = — 1 move towards — 1 as ¢ increases). 

For a further example involving one variable, consider the 
equation 


Pe ANS x >10; 


This occurs in physics, where x denotes the amount of an element ¥ 
subject to radioactive decay. The equation states that, at any given 
time ft, the rate of decay dx/dt is proportional to the amount x(t) 
which remains. Here A is a positive real number, called the decay 
constant. If the amount of X at time t=0 is xo, the equation has 
the unique solution 


x= xe, 
This solution can be represented by a single diagram 


0 x 
——4q——____—_@— 


showing that x decreases to zero as ¢ increases. Notice that since 
by definition x > 0, only the right half of the line is of interest. 
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It is this kind of simplified diagram which is used to represent 
solutions of autonomous systems in two variables. We give an 
example which also arises when considering radioactivity. 

Consider three elements X, Y, Z such that X decays to Y (with 
decay constant A>0) and Y decays to Z (with decay constant 
p>). If x(t), y(t) denote the amounts of X, Y which remain at 
time ¢ then 


As before, we represent x, y by a point in R*; notice however 
that since by definition x > 0 and y > 0, only the top right quadrant 
is of interest. 

Now assume A < yw. What can be said about the relative values 


of x, y? 
The equations imply that if x 40 
ta Z 
dx —Ax Ax 


Therefore the movement of the point (x, y) can be represented by 
curves with the following properties: 
(i) along the line y = 0 each curve has slope — 1; 
(ii) between the lines y = 0 and y = (A/)x the slope is negative; 
(iii) between the lines y = (A/u)x and x =0 the slope is positive. 
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Moreover there is a solution along the line y= kx if and only if 
k = —1+(p/A)k; that is for 


There is also a solution y = yoe~“* along the line x = 0. These facts 
are summarized in the diagram. Notice in particular that if the initial 
position xo, yo has yo < (A/)xo then y will at first increase and then 
decrease. 


4.2 Phase space 


A large class of examples of autonomous systems in two variables 
arise from second-order differential equations. Let tt»x(t) be a 
function representing the movement of a point along a line, and 
subject to a differential equation of the form 


dt? at 


where the function / is independent of t. Let y = dx/dt. Then x(t) 
represents the position at time ¢, and y(t) the velocity at time ¢. 
The above equation is equivalent to the autonomous system 


a 


ay. 
ar, h(x, y). 


It is now possible to plot solution curves in the (x, y)-plane, and 
to show that, if the function A satisfies suitable conditions, there 
is a unique solution through each point xo, yo. The (x, y)-plane, in 
which the distance x is plotted against the velocity y is often called 
phase space. The equation dx/dt = y implies that as t increases, the 
point (x(t), y(t)) will move ‘clockwise’ along solution curves: from 
left to right in the top half y > 0 of the plane, and from right to left 
in the bottom half y <0. 


4.3 Examples 
Consider the equation 


dx 
ae tx = p>o 
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which arises from harmonic motion. It can be written as an auto- 
nomous system 


The equations imply that the origin x =y =O is a rest point. In 
order to plot solution curves note that, if y 40, 


and therefore px + y(dy/dx)=0. Along y=0 the slope is infinite. 
By 3.6 there are solution curves px? + y2=c. As ¢ increases, the 
point (x(t), y(t)) moves in a clockwise direction around an ellipse 
px*+y?=c with centre the origin. The value of the constant c 
may be determined from the position xo, yo when t = 0, since then 
c= px2 + y2. 

An important special case arises when p = 1. Then each ellipse is 
a circle x2 + y2=c. 


y™ dt 


harmonic motion 
A second-order equation which arises more frequently in practice 
is 
d*x dx 
pd besa =O 
Re ge nee 


where p >O and ¢#0. It is often called the equation for damped 
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harmonic motion if g>0, or negatively damped harmonic motion if 
q<0, provided in both cases that q is small. It can be written as an 
autonomous system 


2 he pa ie 
Bo ae P qy- 


The equations imply that the origin x=y=0 is a rest point. As ¢ 
increases, the point (x(t), y(t)) moves in a clockwise direction and 
since 


4 axt+ yp) =2px & ae 
qi (Px +") =2px 7 + 2p = —2gy 


it moves inwards or outwards according as g>0 or q<0. If g?<4p 
the resulting curves are spirals, as is proved in 4.5. 


q>0 q<9 
damped negatively damped 
harmonic motion q<4p harmonic motion 


In all these examples we shall obtain in 4.5 explicit formulae for 
x(t), y(t) in terms of ¢. These imply that there is a solution curve 
through every point xo, yo; however, only four such curves have 
been drawn on each diagram. 

Often it is not possible to obtain an explicit formula for solutions 
of a differential equation, and in such cases the kind of curve 
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sketching used in the above examples must suffice. For example 
consider the second-order equation 


Ga (1-8-(F) |S +20 


dt? dt dt 
where b > 0. It can be written as an autonomous system 
dx _ 
dt 4 
dy 
2 tale ine 1—x2— yp2)p, 
a tee ae 


The equations imply that the origin x= y=0 is a rest point. A 
comparison with the equation for harmonic motion shows that 
moreover the unit circle is a solution curve (since if b(1 — x2 — y2) =0 
the system becomes dx/dt=y, dy/dt=—x for which x2+y2=c 
is always a solution curve). The term q = — b(1 — x? — y?) is negative 
for x, y inside the unit circle, and positive for x, y outside the unit 
circle. Inside the circle x? + y2 = 1 the behaviour of solution curves 
is similar to that for negatively damped harmonic motion. Outside 
the circle x? + y?=1 the behaviour is similar to that for damped 


ide 
y= at 
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harmonic motion. The solution x = y=0 is unstable, since points 
near (0, 0) move away. The solution curve x2+y2=1 is stable 
since nearby points spiral in towards it. 


4.4 Linear systems 


An autonomous equation of the type considered in 3.3 is said to 
be linear if it has the form 


for some real number r. We should warn that in 3.7 the word linear 
is used in a slightly different sense, although both have in common 
the fact that no higher powers of x occur. Note that if r, s are real 
numbers an equation of the form dx/dt =rx +s can be reduced to 
the previous form by a change of coordinates which replaces 
x+(s/r) by x. The results of 3.7 show that every solution of 
dx/dt = rx has the form x = xoe"'. The origin x =0 is a rest point. 
If r>0 the movement is away from the origin; if r <0 the move- 
ment is towards the origin. Essentially only three distinct situations 
occur, which are summarized in the diagram. 


e ry 
r>0 r<0O 
unstable rest point stable rest point 
Pereeererosorer Beer erree 
r=0 


line of rest points 


An autonomous system in two variables is said to be Jinear if it 
has the form 


x 

ae me 
dy _ _ x— 

at px —qy 


where p, q, r, s are real numbers. Note that we no longer assume 
y =(dx/dt) as in 4.2 and 4.3. This would correspond to choosing 
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r=0, s=1, which is in fact the most important special case of (*) 
because it is equivalent to the second-order equation 
2 
a +q : + px =0. 

A solution to (*) will be a pair of functions t+>(x(t), y(t). In 
accordance with the examples of 4.2 and 4.3, the point (x(t), y(t)) 
will be imagined as moving along a solution curve in the (x, y)-plane 
as t increases. Our aim is to list the various patterns of solution 
curves which can arise. For one variable we have just seen there 
are essentially three distinct situations; in the two-variable case 
we list fourteen distinct situations in 4.5. The basic method is 
first to seek straightforward solutions, and then to build up the 
remaining solutions by taking linear combinations of these. The 
following lemmas, therefore, are devoted to results on linear com- 
binations of solutions. 


Lemma. Suppose that x(t), yi(t) and x2(t), ye(t) are two solutions 
of (*), and that c1, c2 are real numbers. Then 


c1xi(t) + coxe(t), crit) + caye(t) 


is a solution of (*). 


Proof. Let x = c1x1 + cox2 and y=ciyi + C2y2. Then 


io ee 
a Oats 


= ¢€1(rx1 + syi) + co(rx2 + sy2) 


=rx + Sy. 


Similarly dy/dt = — px —qy. Therefore x, y is a solution of (*). 


In the next lemma we consider for the first time complex solutions 
of a differential equation. It is often convenient to consider a pair 
(uo, vo) of real numbers as a single complex number Xo = uo + ivo. 
Similarly a pair of functions tt>(u(t), v(t)) can be regarded as a 
single complex function t+>-x(t), t¢D. Here D is, as before, a 
subset of R, and x(t) is a complex number. We write x =u-+iv 
and dx/dt = du/dt + i(dv/dt), and call the functions re x=u and 
im x =v the ‘real’ and ‘imaginary’ parts of x. A complex function 
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is therefore defined by a description of its real and imaginary parts. 
For example, if x = u + iv is a complex number we define 


et = euttv = e(cos v +i sin v) = e“ cos v + ie” sin v. 


There are historical reasons for the names ‘real’, ‘imaginary’ and 
‘complex’, but essentially all that is involved is a convenient algebraic 
mechanism for handling pairs of numbers and pairs of functions, 
by using the ordinary properties of addition and multiplication 
together with the requirement that i2 = — 1. 

A pair of complex functions x(t), y(t) is said to be a complex 
solution of (*) if, with the above definition of derivative, 


at y 
dy _ 
aa px — qy. 


Since p, g, r, s are real numbers, it is almost immediate that this 
statement is equivalent to the following: both re x(t), re y(t) and 
im x(t), im y(t) are solutions of (*). The previous lemma now 
implies 


Lemma. Suppose that x(t), y(t) is a complex solution of (*), and 
that a, b are real numbers. Then 
arex(t)+bimx(t), are y(t)+bim y(t) 


is a solution of (*). 


4.5 Classification of linear systems 


As in 4.4 we use the notation (*) for the linear autonomous system 


Oa rx t sy 
dy _ 
a px — qy 


where p, g, r, s are real numbers. The equations imply that the 
origin x = y=0 is a rest point. Other solutions x(t), y(t) may be 
regarded as curves in the (x, y)-plane. The aim is to classify all 
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patterns which occur, to show how these depend on the numbers 
P; 4, ’, 8, and finally to obtain explicit formulae for the solutions. 


The first step is to ask: is there a point x1, yi for which there 
is a solution along the line joining x1, y1 to the origin? Suppose 
for a moment that such a point exists. Then the corresponding 
solution must have the form 

x=x1if(t) 
y=yif(t) 
where t+>/(t)is a function. Then dx/dt = x: f"(t) and dy/dt = yif'(t) 
so that substitution in (*) gives 
xif'(t) = (rai + sy) S(O, 
ynif'(t) =(—pxi — ani) FO. 
It follows that f(t) is some constant multiple of e™ where 
mX| = rx1+ Sy1, 
myi = — pX1— qy1.- 
Eliminating x1, yi we conclude that m must be a root of the equation 
m? + (q—r)m + (ps —qr)=0. 
We call this the characteristic equation of the linear system (*). 

Conversely, suppose my is a root of the characteristic equation. 

Except in the case r—m,=s=0, any x1, yi such that 
(r—m)x1+ syi=0 

automatically also satisfies the further equation px1 + (¢ + mi)yi = 0. 
Therefore there is a solution 

x= xem! 

y=yiem! 
of (*). If 71, mz are two distinct roots of the characteristic equation, 
then there is another solution 

X = xge™Mat 

y = yeemat 
of (*). Applying the first lemma of 4.4 we have 


Theorem I. Suppose that the characteristic equation has two 
distinct roots my, m2. Let (x1, yi) and (x2, y2) be non-zero points such 
that (r — m)x1 + Sy1 = pxi + (¢ +m1)yi1 = 0 


(r — me2)x2 + sy2 = px2 + (q + me)y2 = 0. 
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There are solutions 
X= cyxye™1! + coxgeMe! 
y=cryie™! + coyge™et 


of (*), where ci, cz are arbitrary real numbers. 


l(i) m > m2>0 Iii) O> m1 > me 
unstable node stable node 
X22 XN 


= \Naie/\Nea 


C= 


\(iii) mi > mz =0 I(iv) 0 =m > me 
unstable line of rest points stable line of rest points 
*272 » 1 
as a 
c,=0 Seen 6 come gaan =0 _ |! OO 
SRE PRES vy s X52 
. —_—_—_—_—"-__ oOo 
ee See eee 
__.’ —_——— ———— a 
“cy=0 “¢,=0 


I(v) m>O0> me 
saddle point 
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Remark. Since m;# mz the points (x1, y1) and (xe, ye) lie on 
distinct lines through the origin. Therefore given xo, yo it is possible 
to find a unique solution of the above form such that x = x9 and 
y=yo when t=0. In fact it can be proved that if m1 # me every 
solution to (*) is of the above form. The curve patterns in the 
(x, y)-plane corresponding to the above solutions are of five basic 
types I(i)-I(v). Note that if m1 > me, and if c1, cz, mi, me, X1, X2 are 
all non-zero, 


dy _ ciyimye™it + coygmge™st 
dx cixime™t + Coxomoe™at 


_ e1yymye(™s—ma)t + Coyema 
 e_xymye(™—ma)t 4 coxX2m2. 


Thus dy/dx approaches 


Coy2me2 _ y2 
Cox2m2 -X2 


the slope of the line through (x2, y2), as t becomes large and negative. 
Similarly dy/dx approaches 


c1yimy ne) 


ciximy xy 

the slope of the line through (x1, y1), as t becomes large and positive. 
We leave the reader to make appropriate adjustments to these 
statements when any of ¢1, c2, 71, me, X1, X2 are zero, and to check 
that the diagrams I(i)-I(v) can be drawn using the above informa- 
tion. 

In order to complete the classification of solutions of the linear 
system (*) it is necessary to consider the possibility that the charac- 


teristic equation does not have two distinct real roots. In all there 
are three cases. 


Case I: two distinct real roots m, > mz. 
Case II: two distinct complex roots m, m. 
Case III: one repeated real root m. 


Case I occurs if (¢+r)?>4ps, and has been considered above. 
We now turn to case II, which occurs if (g +r)? < 4ps. In this case 
therefore s4#0. Suppose that the characteristic equation has a 
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complex root m=f+ig, where g4#0. Then the other root must 
be m=f—ig. Let k=(m-—r)/s. Then the complex number k 
can be written in terms of real and imaginary parts, say k =u + iv. 
(In fact u=(f—r)/s and v= g/s.) 

By the same argument as was used in the case when m is real, 
there is a complex solution of (*) 


x=em 
y=kem 
which can be separated into real and imaginary parts 
x =elt cos gt +ief sin gt 
y = eft (u cos gt — v sin gt) + ieft (v cos gt + usin gt). 
Applying the second lemma of 4.4 we have 
Theorem II. Suppose that the characteristic equation has two 


distinct complex roots m, m. Let m =f + ig andk =(m —r)/s =u + iv. 
There are solutions 


x = aelt cos gt + best sin gt 
y =aelt (ucos gt — v sin gt) + be! (v cos gt + u sin gt) 


of (*), where a, b are arbitrary real numbers. 


Il) f>0 Il(ii) f< 0 
unstable focus stable focus 
om 
Ilqii) f =0 


centre or vortex point 
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Remark. Since m #m we have v #0. Therefore given xo, yo it is 
possible to find a unique solution of the above form such that 
x = Xo and y= yo when t=0. In fact it can be proved that if m4 m 
every solution to (*) is of the above form. The curve patterns in 
the (x, y)-plane corresponding to the above solutions are of three 
basic types II(i)-II(iii) illustrated in the diagram. The flow may 
be in a clockwise or anticlockwise direction; the diagram is drawn 
with flow clockwise. 

It remains to consider case III, in which the characteristic equation 
has a repeated root m. Then (q +r)? = 4ps and m= }(r —q), so that 
also (r — m)? = (q + m)2 =ps. 


One possibility is that p= s =0 and m=r= —g. In this case (*) 
becomes 
dx _ bee 
dt 
dy 
a= a= IY) 
no 
Ill) m>0 Iii) m<0 
unstable node stable node 


VEZ NL 
AS IS 


Il(iii) m=0 
plane of rest points 


4. AUTONOMOUS SYSTEMS 65 


Then (xoe™, yoe™) is a solution of (*) for any real numbers xo, yo. 
The corresponding curve patterns III(i), (ii) are similar to I(i), (ii) 
but every curve is straight. Again, there is a unique curve through 
each point (xo, yo). In case III (iii) the only solutions are constants 
x = X0, Y= yo. 

The other possibility is that p, s are not both zero. In this case 
the repeated root m yields solutions 


x=xy emt 
y=yie™ 


where the point (x1, y1) is determined up to a scalar multiple by the 
equation 
(r —m)x1 + sy: =0, 


or the essentially equivalent equation 
— pxi—(q+m)yi =0. 


Now choose some point (x2, y2) which is not a multiple of (x1, y1), 
and define 


a, = (r — m)x2 + Sye, 
bi = — px2—(q + m)y2. 
It follows from the relations (r — m)? = (q¢ + m)? = ps and 2m =r—q 
that a1, b; satisfy (r—m)ai+sbi1=0 and —pai—(q+m)bi=0. 
Therefore (a1, 51) is some multiple of (x1, yi). Thus there is a real 
number f such that a; = fx and b; = fy1. Consider the functions 
x = (fxit + xo)em, 
y=(/nit + ye)e™. 


It is easy to check that the above relations imply that x, y is another 
solution of (*). By the first lemma of 4.4 any linear combination of 
the two solutions obtained is also a solution. Therefore if ci, ce are 
arbitrary real numbers the functions 


x =(c1 + c2ft)x1e™ + coxze™ 
y=(C1 + coft)yie™ + coyze™ 


give a solution of (*). Again there is a unique curve through each 
point of the plane. The curve patterns III(iv), (v) are similar to 
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Ill(iv) m>0 Ill(v) m<0 
unstable node stable node 
xp eli 
e e 
Cc =0 ey oa 0 
*2-2 
*202 
>= 0 c= 0 
Ill(vi) m=0 
boundary layer 
ded 


¢2=0 c,;=0 


I(i), (ii) but now the two straight line solutions have coincided, 
and dy/dx approaches the slope of the line through (x1, y1) both 
as t becomes large positive, and as t becomes large negative. For 
III(vi) see example 2.12: points on opposite sides of the line of rest 
points move in opposite directions. 


Remarks. Not all the fourteen types of linear system I (i)-(v), 
11(i)-(iii), IM(i)-{(vi) are of the same significance from a physical 
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point of view. In most physical situations we expect structural 
stability: that is, a small change in the coefficients p, q, r, s leads to 
a small change in the solution curves. 

Clearly a small change in the equation giving I(iii) will yield 
either situation I(i) or I(v). Therefore I(iii) is not structurally stable; 
neither are I(iv), II(iii) or III(i)-(vi). However, the fact that a situ- 
ation is unlikely to occur in physics does not prevent its being of 
interest to the mathematician (and even to the physicist —as is 
shown by the example of harmonic motion, of type II(iii), and by 
the example of zero acceleration, of type III(vi)). 


4.6 Second-order linear equations 


The detailed results of 4.5 can be applied to the second-order 
equation 


ag +9 HP Oyo) 


to find solutions t+ x(t). Here p, q are real numbers and the cor- 
responding autonomous system is 


e 
dt y;, 


dy _ 
ea Pa ay- 


In the analysis of 4.5 we put r=0, s=1. Then the characteristic 
equation of the system becomes 


m2 + qm +p=0. 


This equation is also called the auxiliary equation of (**). If m 
is a root of the auxiliary equation we take x1=1, y1=m-—r as 
the non-zero point satisfying (r — m)x1 +sy1=0. Then Theorem I 
of 4.5 implies immediately: 


Theorem I. If g? > 4p the auxiliary equation of (**) has two distinct 
real roots m= —4qg++/(q2—4p) and mz= —4g—+/(q?—4p). 
There are solutions 


x =cye™! + coemat 


of (**), where ci, cz are arbitrary real numbers. 
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The corresponding diagram of solution curves in phase space 
will be of 
type I(i), unstable node, if g? > 4p > 0, g <0, 
type I(ii), stable node, if g2 > 4p > 0, q>0, 
type I(iii), unstable line of rest points, if p = 0, q < 0, 
type I(iv), stable line of rest points, if p=0, q > 0, 
type I(v), saddle point, if p < 0. 
In the same way Theorem II of 4.5 implies 


Theorem II. Jf g2<4p the auxiliary equation of (**) has two 
distinct complex roots f + ig, where f= —4q and g=}+/(4p —q”). 
There are solutions 
x = aelt cos gt + bet sin gt 
of (**), where a, b are arbitrary real numbers. 
The corresponding diagram of solution curves in phase space will 
be of 


type II(i), unstable focus, if g2 < 4p, q < 0, 
type II(ii), stable focus, if g? < 4p, g > 90, 
type II(iii), centre, if p > 0, g =0. 

The final case is dealt with by 


Theorem III. If g2 = 4p the auxiliary equation of (**) has a repeated 
root m= — }q. There are solutions 

x = (ci + cot)e™ 
of (**), where ci, C2 are arbitrary real numbers. 


Proof. We put r=0, s=1 in the analysis of 4.5. Since s #0 the 
cases III(i), III(ii), IM(iii) cannot arise. We choose x1 = 1, yi = — 49 
and x2=0, ye=1. It then follows that a: = 1, b1 = — $q and hence 
that f=1. Therefore the final solution obtained in 4.5 becomes 
x =(c1 + cot)e™. 

The corresponding diagram of solution curves in phase space will 
be of 

type III(iv), unstable node, if g2 = 4p, q <0 

type III(v), stable node, if g? = 4p,q>0 

type III(vi), boundary layer, if p=q =0. 
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4.7. Examples 


(i) Consider the equation 


dx dx 
The auxiliary equation m? — 3m + 2 =0 has roots m= 1 and m=2. 
By Theorem I there are solutions 


x = cyet + cet 


where cj, ce are real numbers. 
(ii) Consider the equation 
d2x dx 
dz or a +x=0. 
The auxiliary equation m2 + m+ 1=0 has roots m= — } + i(+/3/2). 
By Theorem II there are solutions 


x = ae~'*t cos (: v3) + be-* sin (« v?) 


where a, 6 are real numbers. 
(iii) Consider the equation 
ax _ 4 & 
dt? dt 
The auxiliary equation m2 — 2m + 1=0 has a repeated root m=1. 
By Theorem III there are solutions 


+x=0. 


x =(¢1 + coft)et 
where ¢1, C2 are real numbers. 


Exercises 
1 Let 

dx 

= —dyx 

dt 


be the equation controlling the radioactive decay of an element 
X, as in 4.1. The half life T of X is defined as the time taken for 
half a given amount of X to decay. Prove that 


T =~ log Pt 
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Consider the autonomous system 


se 

dt 

dy _ 
ante 


Show that there are solution curves lying along the lines x =0 
and x + y=0. Deduce that the solution curve through (xo, yo) 
is 
x = xoet 
= (xo + yo)e?! — xoet. 


Use the substitution ¢ = e“ to solve the differential equation 


2 
2 wn 2 + 2x =, t>0. 


What is the appropriate substitution in the region t <0? 


Write down differential equations with the following solutions: 
(i) x =e! (a cos (t1/3) t +b sin (t4/3)), 

(ii) x = aet + be-2t, 

(iii) x = (a + dt)e~*t. 

Find all solutions of each of the following differential equa- 

ae 


5 & a RX dx 
@? a 5 7 + 6x =0, (ii) a 
en eX dx dx _ 


Find a solution of each of the following differential equations 
with the property: x =0 and dx/dt = 1 when 1=0. 
d’x dx 


() Fa 3G + 2x=0, 

(i) FF tx= 0, 

i ee 
7 &x 

Gy) & a 2a +2x=0. 


CHAPTER FIVE 


Linear equations 


The word ‘linear’ has already been used in three senses: to describe 
first-order equations of the form (dx/dt) + xg(t)=A(t) in 3.7, to 
describe the autonomous system 


= =rx+sy 
dy _ 
nae px — qy 
in 4.5, and to describe the second-order equation 
75 3 
eo 


in 4.6. In this chapter we seek to justify our use of the word by 
placing these three examples in a single framework. The essential 
feature is that given two solutions of the equation, any linear com- 
bination of them will be a solution either of the given equation, 
or of a closely related equation. This fact leads directly to the 
results often summarized as rules about ‘arbitrary constants’, 
‘complementary functions’, and ‘particular integrals’. 


5.1 Linear operators 


Let DZ be a subset of R which is kept fixed in all that follows, but 
which in practice would often be the whole of R. We consider 
functions t->x(t) with domain Z. The idea behind linearity is that 
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any linear combination of functions with domain @ is itself a 
function with domain @&. If ci, cz are real numbers and x, x2 
are functions with domain @ then cx + ceXx2 is the function defined 
for all te DZ by 


(c1xX1 + c2Xx2)(t) = c1x1(t) + c2X9(f). 


Let V be the collection of all functions t+ x(t) with domain 9 
which are infinitely differentiable; that is, the r-th derivative d'x/dt" 
exists for every integer r > 0. If x1, x2 are functions in V then so is 
c1X1 + Coxe because 

r r r 

- (cix1 + C2x2) = ¢1 sie + C2 es 

It is often convenient psychologically to think of x as an element, 
or point, of V rather than as a function f>x(t). This makes it 
possible to consider functions which associate, to each element 
x € V, an element 7(x) € V. We use the notation T: V->V for such 
a function, but give it a special name to avoid confusion with the 
functions tt+x(t) which are elements of V. 


Definition. A function 7:W-—>V is a linear operator if, for all 
c1, cg ER and x1, x2 EV, 


T(c1x1 + c2xX2) = c1T (x1) + c2T(X2). 


Examples. (i) Let c be a real number. The function x!~cx is a 
linear operator c: VV. 

(ii) Differentiation x! (dx/dt) defines a linear operator D: VV. 
Similarly the r-th derivative xi (d’x/dt") defines a linear operator 
D':V—>V. 

Gil) If geV the xt+>(dx/dt)+xg is a linear operator 
(D+g):V—V. 

(iv) If p, g are real numbers then 

ue i Maen 
ane. +q a + px 
is a linear operator (D?+qD+p):V—V. 

(v) If a1,..., an € V then 
dex, 4, enix 


+a 


aaa 1 ini 


+ 59+ +anx 
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is a linear operator (D"+a,D"-1+ ++++an):V—V. Here 
ai,..., Gm are elements of V (i.e. functions with domain 9). If 
ai, ..., Gm are all real numbers (i.e. constant functions) the linear 
operator is said to be of n-th order with constant coefficients. 

The above examples suggest that certain differential equations 
can be written in the form 7(x)=0, where T:V-—V is a linear 
operator. This leads to the following terminology. If T:V—V is a 
linear operator, the collection Vo of all x € V such that T(x) =0 is 
called the solution set, solution space or kernel of T. An element 
x € Vo is called a solution of the equation T(x) =0. 

The definition of linear operator implies immediately: 


Lemma. Let T:V —V be a linear operator and Vo = {x EV: T(x) = 0}. 
If x1, X2 © Wo then c1x1 + c2x2 is an element of Vo for any real 
numbers C1, C2. 


Translated in terms of solutions this lemma becomes: if x1, x2 
are two solutions of the equation 7(x)=0 then cyx1+cexe is a 
solution for any real numbers ci, ce. 

This may be compared with the first lemma of 4.4 which results 
from the fact that the function 


dx dy 
(x, yro( 1k — So a 


is a linear operator V2--V2. Here V2 denotes the set of pairs 
(x, y) with x € V, y € V, and linear combination of pairs defined by 


+ px +4») 


c1(%1, ¥1) + Co(x2, Ye) = (cix1 + C2X2, C1y1 + C2y2). 


This explains the use of the word J/inear in 4.5. 
More generally the words /inear equation are often applied to an 
equation of the form 


T(x) =h 
where T:W-—>V is a linear operator, and A is a fixed element of 


V (i.e. a function t}>A(t) with domain 9), for example the equation 


= + xg(t) = h(t) 


considered in 3.7 is of this kind, with T the linear operator D + g of 
example (iii) above. 
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Lemma. Let T:W->V be a linear operator, and y €V a particular 
solution of the equation T(x) =h. Then every solution of T(x) =h has 
the form yo + y, where yo is a solution of the equation T(x) =0. 


Proof. The definition of linear operator implies that 


T(yo + y) = T(yo) + Ty) =0+h=h 


and therefore yo + y is a solution of 7(x) =A. Similarly if z is an 
arbitrary solution of 7(x)=/ then 


T(z — y) = T(z) —T(y) =h-h=0 


and therefore z — y = yo for some solution yo of T(x) =0; in other 
words, every solution z of T(x) =h has the form yo + y. 


Corollary. Let x1, ... , Xn € V be functions with the property: every 
solution yo of T(x)=0 has the form yo=cixX1+ *** +¢nXn where 
C1,.++5 Cn are real numbers. If y €V is a particular solution of 
T(x) =h then every solution of T(x) =h has the form 


CiXit *** + CnXa TY: 


There are traditional names for some of the terms which occur 
in the corollary. The function y is called a particular integral of 


T(x) =h. The expression c1x1 + *** +CnXn is called the comple- 
mentary function, and the real numbers ci, . . . , Cn are called arbitrary 
constants. 


Example. Consider the equation 


d’x dx 
Lee sae 
(1+ 0) So + 2S = 24. 


It is of the form 7(x)=h where h is the function ¢++2t and T is 
the linear operator (1 + t2)D? + 21D. The equation can be written 


d * Gk\ 
Therefore 


dx 
a) 2 
(+e) — 1+f4+¢1 
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where ¢ is a real number. It follows that 

ax 44% 

dt 1+? 


x=t+c,tan-1t+ ce 


where ¢1, C2 are real numbers. Here f¢ is the particular integral, and 
c; tan-! t+ cz is the complementary function. The arbitrary con- 
stants ci, cg can be determined as soon as additional information is 
specified about the desired solution. For instance, suppose we seek 
a solution to the above equation for which x =0 and dx/dt=2 
when ¢ = 0. Substitution of these values gives ci = 1, co = 0. There- 
fore the solution with the required values when t = 0 is 


x=t+tan-!t. 


5.2 Linear equations with constant coefficients 


Consider the equation 


n—1 
Ox dn-lx 


aim ss a 


where h is a fixed element of V (i.e. a function t~A(t) with domain 
Q) and a, ..., Qn are real numbers. It can be written in the form 


T(x) =h 


where T:V-—>V is the linear operator D® + a,;D"-1+ +++ +n of 
example (v) in 5.1. By the second lemma of 5.1 it is possible to find 
all solutions of the equation 7(x) =h in two steps: 


(i) find all solutions of T(x) =0, and 


(ii) find a particular solution of T(x) =h. 
A method for carrying out step (ii) is given in 5.4; however, in 
practice it is often possible to guess a particular solution. We there- 


fore concentrate first on step (i). 
As in 4.6 we introduce the auxiliary equation 


m® + aum*—1 + *** +a, =0. 
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Lemma. If the real number m_ satisfies the auxiliary equation 
m®™ + aym™-1 + +++ +a, =0 then 


x=cemt 


is a solution of the equation T(x) = 0 for any real number c. 


Proof, If x = cemt 
T(x) = (D" + a, D"-1 + +++ +an)cem 
= D*(cem) + a, D"-1(cem) + +++ + an(cem) 
= m"™(ce™) + aym™-1(ce™) + +++ + an(ce™) 
= (m™ + aym™1 + +++ + an)cem =0. 


It may happen that the auxiliary equation has a complex root 
m=f+ig. In this case the same argument will imply that any 
multiple of 


emt — efttigt — eft(cos gt + i sin gt) 


is a complex solution of the equation T(x) =0. The same argument 
used already in the second lemma of 4.4 then implies: 


Lemma. I[f the complex number m=f+ ig satisfies the auxiliary 
equation m™ + aym™-1 + +++ + an=0 then 


x =ael cos gt + bef sin gt 


is a solution of the equation T(x) =0 for any real numbers a, b. 

By taking linear combinations of the solutions given by the pre- 
ceding lemmas, we can build up more complicated solutions of the 
equation 7(x) =0. The result is: 


Theorem. Let T:V—V be the linear operator 
Dt + QD? p+? + ay 


where ai1,..., @n are real numbers. Suppose that the auxiliary 
equation 

m® + aym™-1+ +++ +a,=0 
has n distinct roots: 2s complex roots fi + igi, ...,fs + igs andn —2s 


real roots mi, ..., Mn-2s. Consider the functions 
x; = efjt cos gyt l<j<s 
Xe+z = eft sin git l<j<s 
Xestk = emet l<k<n-2s. 
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Then for any real numbers c1,..., Cn the equation T(x)=0 has a 
solution 


X=C1X1+ *°° +CnXn. 


This theorem contains as a special case the solution to the equation 
(dx/dt) + xa=0 obtained in 3.7, and also cases I and II of the 
solutions to the equation (d?x/dt?) + q(dx/dt) + px =0 obtained in 
4.6. To obtain a generalization of case III we must allow for the 
possibility that the auxiliary equation has some repeated roots. 

It can be checked explicitly that, if m is a root of the auxiliary 
equation of multiplicity r, the functions t*e™ are solutions of the 
equation 7(x) = 0 for k=0, 1,..., r—1. This implies: 


Proposition. Suppose that in the above theorem xi = *** = Xi+r-1 
because of a root m of multiplicity r. Then in the expression 
X=cixXy+ +++ +CnXn the terms cixXit ++ * + Citr-1Xi+r-1 may be 
replaced by (ci + cisit + *** + Ci+r—it?-1)%4. 


Remark. It is also true, although we have not given the proof, that 
every solution of the equation T(x) =0 is of the form specified in 
the theorem when the auxiliary equation has distinct roots. If there 
are some repeated roots then again every solution is of the form 
specified, provided that the expression ci1x; + ++: + CnXn is modified 
as in the above proposition. 


Examples. (i) Consider the equation 
nO ot ll « _ 6x = 20 cos t. 
This has the form 7(x)=/h where T= D?—6D2+11D—6 and 
h is the function t++ 20 cos t. The auxiliary equation is 
0 = m3 — 6m? + ilm— 6=(m — 1)(m — 2)(m — 3). 
Therefore every solution of 7(x) =0 has the form 
x = cyet + coe + cge%. 


This is the complementary function. To find a particular solution 
it is reasonable, since h(t) = 20 cos ¢, to try out linear combinations 
of cos ¢ and sin ¢. In fact 


T (cos t)=sint+6cost—11sint—6cost=— 10sint, 
T (sin t)= —cost+6sint+11cost—6sint=10cost. 
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Therefore x = 2 sin ¢ is a particular solution, and every solution is 
of the form 


x = cyet + coe + cge3t + 2 sin ¢. 


In practice the arbitrary constants c1, c2, cz are often determined by 
the initial conditions, i.e. the values of x and its derivatives for some 
fixed value of ¢. For instance the solution to the above equation 
may be required which has 


x=0; 


when ¢ = 0. Substitution of these values gives 
O=cy1+¢24+¢3 
0=c1 + 2c2+ 3c3+2 
—6=c1 + 4c2 + 9c3 
and hence ci = 2, cp = — 2, cs = 0. Therefore the required solution 
is 
x = 2(et — e2! + sin t). 


(ii) Consider the equation 


Here T= D?—2D2+ D—-2 and A is the function t:>4et. The 
auxiliary equation is O=m°—2m?2+4+m—2=(m-—2)(m?2 +1). 
Therefore the complementary function is 


x=cje"4 + cocost+c3 sin t. 


To find a particular integral it is reasonable, since h(t) = 4e*, to try 
out multiples of e’. In fact 


T (et) = et — 2et + et — 2et = — 2et 


and therefore x = — 2e¢ is a particular solution. Thus every solution 
is of the form 


x = cje"t + co cos t+ cg sin t — 2et. 


where ci, c2, c3 are real numbers which may be determined from 
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the initial conditions. For instance the solution with values x =0, 
dx/dt =0, d2x/dt? = 1 when t=0 has 


O=c1+c2—2 
0 = 2c; + c3 —2 
1 =4¢e, —c2-—2 


and therefore c, = 1, co=1, cg =0. 
(iii) Consider the equation 


he ue ic, oa 
ae ae ge 


Here T= D?— D?— D+1 and h=2. The auxiliary equation is 


0=m3—m2—m+1=(m+1)(m—1)2. There are solutions of 
T(x) = 0 of the form 


x =cye~* + coet + cget. 


However, according to the above proposition, the last two terms 
may be replaced to obtain the more general expression 


x =cie~* + (co + cst)et. 


Clearly x =2 is a particular solution. Therefore every solution is 
of the form 


x =cye-* + coet + cgtet + 2, 


where ¢1, ¢2, C3 are real numbers which may be determined from the 
initial conditions. 


5.3 Stability 
Consider the linear equation 
LO=h 


where T= D" +a,D"-1+ +--+ +a, is as in 5.2. If ye V is a 
particular solution then by the results of 5.1 and 5.2 every other 
solution has the form 


X=C1Xit °** +CnXnty 


where ¢1,..., Cn are real numbers and x1,..., Xn are functions 
determined by the auxiliary equation. 
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Under what circumstances will any two particular solutions 
become arbitrarily close for large values of 1? Since any two parti- 
cular solutions differ by a function of the form cyx1 + *** + CnXn 
it is equivalent to ask: for what equations do the functions 
x1, ..., Xn become arbitrarily small for large values of t? 


Definition. The equation T(x) =0 is stable if every solution tends 
to zero as ¢ tends to infinity. 


To make this definition precise needs a discussion of limits and 
continuity. For the present purposes it is sufficient to know the 
following fact about exponential functions (compare Moss-Roberts, 
Theorem 4.5.9): if k > 0 then, as ¢ tends to infinity, t*e™* tends to 
zero if m <0 and to infinity if m > 0. 


Theorem. The equation 
oF a 
dt” ate? 
is stable if and only if every root of the auxiliary equation 
m™ + aym®-1 + +++ +a,=0 
has negative real part. 


+°*** +anx=0 


Proof. By the theorem of 5.2 the roots of the auxiliary equation 
determine functions x1,..., Xn. The equation is stable if each x; 
tends to zero as ¢ tends to infinity. But x; has one of the forms 
tkemst, tkel;t cos git, tkeljt sin gt, the power of ¢ being zero unless 
there are repeated roots of the auxiliary equation. In each case the 
function tends to zero, as ¢ tends to infinity, if and only if m; <0 
or fj < 0. 

In the case n = 2 this notion of stable links up with the terminology 
already used in 4.5 and 4.6. The statement that 


oe +q ns +px=0 
is stable corresponds to the statement that the autonomous system 
dx 
a 
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has a stable node or focus at'x = y = 0; that is, solution curves run 
in towards the origin as ¢ tends to infinity. The analysis of 4.6 
shows that the equation (d2x/dt®) + q(dx/dt) + px =0 is stable if and 
only if p>0, g>0; this condition agrees with that of the above 
theorem because the roots of m?+qm-+p=0 have real part — 4q 
if g2< 4p, and real part — $q + $./(q? — 4p) if qg? > 4p. 

The importance of stable equations lies in the fact that often a 
solution of 

T(x) =h 


is required only once a ‘steady state’ has been reached; in other 
words only for large values of t. If T(x) =0 is stable then any two 
particular solutions of T(x)=h will become arbitrarily close for 
large values of ft, so that for many purposes it does not matter which 
particular solution is chosen: the behaviour of the solution for large 
values of t is independent of the initial conditions. 

For example consider the equation 


d?x dx 
Since 2 >0 and 3 > 0 the equation 
dx dx 
a +2 ze +3x=0 


is stable. Moreover x = 3 is clearly a particular solution. Therefore 
every solution tends to the value 3 as ¢ tends to infinity; this holds 
whatever the initial conditions. 


5.4 Particular solutions 
We consider second-order equations 
dx dx 
~, +q—-+px=h 
wea 
where p, q are real numbers and A is a function t+>A(t). The aim is 
to find a particular solution. 

In practice the best method is inspired guesswork. However, we 
give an alternative method which is surer but often slower; it can 
be extended to higher order equations, and to the case that p, q 
are non-constant functions. This is the method of variation of 
parameters. 
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Suppose that the solutions of the equation 


d2x dx 
dt? Ml 


have been found in the form 


+px=0 


X = C1X1 + Coxe 


where ¢1, cg are arbitrary real numbers. Consider functions of the 
form 
X = V1X1 + Vexe2 


where vj, ve are non-constant functions. Then 


dx (dv, dvz dx, dx2 
o-(3 ete xs) +(0 wt” =), 


Suppose that 
dv, dveg al 
dt x*1+— dt ==\)) 


Then we have 


wen (aoe oS) +(c WP 5 oa) 

at? \dt dt dt dt ae ap 

and hence 

d’x dx dv; dx, . dv2 dxe d?x, dx, 

ae tg ther (aS Be) +0 a(S ly +px:) 


d?x¢ dx2 
+ 0o( +g — a +pxs) 
isk dv, dx, dv2 dxo 


dt dt dt dt’ 
It follows that x will be a solution of 
d?x dx 
ae +q - a +px=h 
if v1, vg satisfy the equations 


dv, dve 
at x1 +— at 
dv; dx} dvz dxe 


dt dt dt dt 


2 x2=0, 


=h. 
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Elimination gives the equations 


a dxe_ dx, 
ON an ae 


dve dx2 dx 
- (x i x2 a) = xih 


which may be solved to give (dvi/dt), (dve/dt); and then integrated 
to give functions v1, ve. Of course in a specific example it may not 
be possible to perform the integration explicitly. We give two 
examples in which it is possible. 

(i) Consider the equation 


d*x 1 7 7 
BT aa ae 


Every solution of (d?x/dt?) + x =0 has the form c1x1 + cex2 where 
x1 = cos ¢t and x2 =sin ¢. Since 


dxe dx, at 2 - 
a (cos t)? + (sin ft)? = 
the equations for v1, ve become (dv:i/dt)= —(sin t/cos t) and 
(dv2/dt) = 1. Hence a particular solution is 


Gi) = — xh 


and 


x = (log cos t)x1 + txe 
= (log cos t) cos t+¢ sin t 
and every solution has the form 
x=c,cost+c2 sin t+ (log cos t)cost+fsint. 
(ii) Consider the equation 
ax dx 
dt? P 


In this case we compare the method of variation of parameters 
outlined above with the method of inspired guesswork. 


—2x=e'+sint—4t. 


Inspired guesswork 
The equation 
ots dx 
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has a solution x = 2t. Therefore the equation 


d’x dx 
has a solution x = 2¢+ 1. 
The equation 
x ax van 
di +] 2=€ 


is likely to have a particular solution ce‘; substitution shows that 
this means (1 + 1 — 2)c =1 which is impossible. As a second guess 
try cte’; this time (c+c+ct)+(c+ct)—2ct=1 and therefore 
c= 1/3. Thus x = (1/3)te? is a particular solution of 


ax ax Lites 
die tt 2x= e"s (2) 
The equation 
d’x dx ; 
ai ae —2x=sint 


is likely to have a particular solution a cos t+6 sin t; inspection 
shows that this means 

(—a+b-—2a) cos t+(—b—a-— 2b) sin t=sin t. 
Therefore b= 3a and a= — 1/10. Thus 


1 ae 
X= — 7 C08 t— 75 sin t 


is a particular solution of 
d’x dx : 
—— +——2x=sint. 
de nt ai x = sin (3) 


New using the fact that the equation is linear, we can add the 
particular solutions obtained for equations (1), (2), (3) and assert 
that the sum 


x= M4143 tet 1 cost— > sint 


is a particular solution of the original equation (ii). 


Variation of parameters 
The equation 
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has solutions c1x1 + cox2 where x; = e~2t and x2 = et. Now 


sc ) aS ee 
*1 ame et + 2e-2tet = 3¢ 


so that the equations for v1, ve become 


3 S = —e% (et + sin t— 41) = — e3t — et sin ¢ + 4re2t, 


dog _ 
at 


and corresponding integrals are 


~t (et + sin t— 4t) = 1 + e-¢ sin t — 4te-t, 


30) = — jem + ; et (— 2 sin t + cos f) + 2te2 — e2t, 


3ve=t- ; e~ (sin t + cos t) + 4te-* + 4e-t. 


Thus the particular solution obtained for the original equation (ii) is 
1 


Pie oe / 2 
( 5° +75 ¢ 2sin t+ cost) +51 3) 


+(5 tet — © (sin t+cos n+5¢+4) 


3 3 3 
Mv, 1 ess ay Soe 
= 9° +att1 +. te To °°8! To i ¢ 


Note that the two methods yield particular solutions which differ 
by (1/9)et; this is a solution of (d?x/dt?) + (dx/dt)—2x=0 in 
accordance with the second lemma of 5.1. 


Exercises 


1 Let T:V-—V be the function which associates to each x € V the 
element 7(x)=y € V described below. In which cases is T a 
linear operator? 


(i) y)=1, (ii) 1) =0, 

(ill) y() = @(N)?, (iv) y(t) = #%(dx/dt), 
t 

() WO= f xW)du, (vi) Wi) = 4. 


0 
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Prove that every real number c defines a linear operator which 
associates to each x € V the element cx. 

Prove that if S, T are linear operators then so are the functions 
ST and S+T defined by 

(ST)(x) = S(T(x)), 
(S + T)(x) = S(x) + T(x). 
Deduce that 7° =7...T (r factors) is a linear operator, and 
that if a, b are real numbers then 
(T + a(T +b) =T? + (a+ b)T + ab =(T + d(T +a). 


Let T be the linear operator which associates to x € V the 
function t+ tx(t). Prove that DT-TD=1. 


Prove that if m is a real number (D — m)(e™g) = e™ Dg for any 
g €V. Deduce that (D — m)'(e™g) = e™D'g. Hence show that 


x=(cot+cit+ *+* +¢r-1t?-Yem is a solution of the equation 
(D — m)'x =0 for any real numbers ¢1, ..., Cn. 
Prove that the equation m3 + m2 +m +6 has a root m= — 2. 
Show that the equation 

d®x  d*x dx 

— +— +— + 6x =0 

a ae 


is not stable (even though the auxiliary equation has positive 
coefficients). 


Use the method of variation of parameters to find a particular 
solution to the equation 


PE amie 

dt? ~  (l+e)? 
Find all solutions of the following equations; also the solution 
with x = 0, dx/dt = 1 when t=0. 


2 2 
(i) s _~x=13, (ii) oe aint 
seey (EEX dx ee ae F 
pti sta mee Fa SIN ci = 
(iii) i +2 - + 4x = etcos 21, (iv) ae +x =sin 2t, 


d?x dx ; « 4*x 
W) oa t4 7 + sxm tains, (vi) ag + x = cost. 


CHAPTER SIX 


Guide to further 
reading 


The reader interested primarily in applications of differential equa- 
tions will find his future reading determined by the fields in which 
he works. In chemistry, economics, engineering and physics there 
are many textbooks dealing in greater detail with particular differ- 
ential equations which arise, and with the methods needed for their 
solution. The present chapter is intended rather to give an indication 
of the further development of the mathematical theory, and to 
explain why anyone interested in differential equations should also 
be interested in linear algebra and analysis. 


6.1 Linear algebra 

Many of the results of Chapters 4 and 5 are special cases of theorems 
about vector spaces. For the present discussion it is not necessary 
to know the precise definition of a vector space. The essential 
feature is that, if v and w are two elements of a vector space W, 
then so is the linear combination av+bw for any real numbers 
a, b. Examples of vector spaces which occur in the previous chapters 
include: 


R © set of all real numbers x, 

R2 set of all pairs v = (x, y).of real numbers, 

R” set of all n-ples v= (x1, ..., Xn) of real numbers, 

V_set of all infinitely differentiable functions t++x(t) with 
domain J, 

V2 set of all pairs v = (x, y) with x, ye V. 
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If W, W’ are two vector spaces, a function ¢:W—-W’ is a rule 
which associates an element ¢(w) € W’ to each w € W. The function 
¢:W—-W’' is a linear map if 


$(av + bw) = ap(v) + bp(w) 


for all a, b€ R and v, we W. For example the linear operators 
of 5.1 are linear maps T:V—V. Similarly the function 


(x, y)t> (rx + sy, — px —qy) 


of 4.4 is a linear map ¢:R2->R2. Many theorems about differential 
equations are best understood in terms of results on vector spaces 
and linear maps. For this purpose the following concepts are 
important. 

The kernel of a linear map ¢: W->W’ is the set 


Wo = {w € W:4(w) = 0}. 


The definition of linear map implies that ¢(v) = ¢(w) if and only if 
v — wis in Wo. The set Wo is itself a vector space, since if v, w € Wo 
then av+bw € Wo. The lemmas in 5.1 are special cases of these 
properties. 

The dimension of a vector space W, if it exists, is the minimum 
integer n for which the following result holds: there exist elements 
W1,---, Wa € W such that every w € W can be expressed uniquely 
in the form 


W=CiWit+ *** +CnaWn 


where ¢1,..., Cn are real numbers. If no such integer exists then 
the dimension of W is said to be infinite. For example the dimension 
of R2 is 2, since any w € R2 can be expressed uniquely in the form 
x(1, 0) + »(0, 1) where x, y € R; similarly the dimension of R® is n. 
On the other hand the dimension of V is infinite. The main theorem 
of 5.2 states that, if 7: WV is the linear map 


DP + abet + ¢ "Gy 


where a}, ..., @n € R, then the kernel of T has dimension n. The 
concept of dimension is needed to make precise intuitive ideas 
about ‘arbitrary constants’ and ‘degrees of freedom’. 

The eigenvectors of a linear map ¢:;W-—>W are those elements 
w € W such that mw = ¢(w) for some real number m. We give two 
examples to illustrate the fact that many properties of ¢ may be 
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deduced from corresponding properties of the eigenvectors of ¢. 
Firstly, let D: WV be the linear map x++>dx/dt of 5.1. Its eigen- 
vectors are the functions x =ce™! where c, me R. Secondly, let 
¢:R2—R2 be the linear map (x, y)H>(rx+sy, —px—qy) of 4.4 
Its eigenvectors are the elements (x1, y1) € R2, such that 


MX, = rx, + SV1 
myi = — PX1 — qy1 


for some m € R, which played a central role in the proof of 4.5. 

The basic properties of vector spaces, linear maps, kernels, 
dimension and eigenvectors may be found in many textbooks; for 
example 


K. Hoffmann and R. Kunze, Linear Algebra (Prentice-Hall, New 
Jersey, 1961), 

N. H. Kuiper, Linear Algebra and Geometry (North-Holland, 
Amsterdam, 1962). 


6.2 Analysis 


It has been mentioned in 1.7 that a precise definition of differentiation 
and derivative requires the concept of a continuous function 
f:9->R. Here the domain @ is contained in R, and / is a rule 
which associates a real number f(t) to each t € Z. If Z is an interval 
then every differentiable function is continuous, and every con- 
tinuous function is integrable. However, the converse statements 
are false. All properties of differentiable functions, including assump- 
tions 1.10 and 1.12, the chain rule, the rules for differentiating 
sums and products, and the precise definitions of trigonometric 
and exponential functions, depend ultimately on the properties of 
continuous functions developed in a first-year university analysis 
course. Suitable references are 


R. M. F. Moss and G. T. Roberts, A Preliminary Course in Analysis 
(Chapman and Hall, London, 1968), 

T. M. Flett, Mathematical Analysis (McGraw-Hill, London, 
1966). 


The latter book discusses in addition the continuity and differen- 
tiability of functions f:2-+R” where the domain @ is contained 
in R™, This leads to the definition of partial derivatives, and to such 
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results as the chain rule and inverse function theorem for functions 
of several variables. The study of such functions leads to partial 
differential equations; these have a vast literature and many applica- 
tions, but a discussion of these would lead far away from the scope 
of this book. We mention, however, three examples in which func- 
tions of this type have already occurred in earlier chapters. 

(i) The differential equation 


Fafn, Une”, 
considered in 3.5 involves a function f:e” +R where c” is a region 


in R2, This is the case m=2,n=1. 
(ii) The linear system 


dx 
es rx + sy 
dy _ Os | 
ae px —qy 
considered in 4.4 can be written in the form 
B= $0), v=(% ER’, 


where ¢:R2-—>R2 is the linear map mentioned at the end of 6.1. 
Solutions are functions v:R—R2 which associate to each teR 
the point v(t) = (x(t), y(t) € R?. 

(iii) The differential equation 


—— + + +++ +anx=0 
dm" ** din idee, 
can be turned into a system of first-order equations by substituting 
X1=x, X2=dx/dt, ..., Xn =d"-1x/dt"-1. It can then be written 
dx1 =~ 
dt , 
axn-1 
=x. 
dt . 
dxn 
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If ¢:R" Rv? is the linear map which associates to 
v=(x1,..., Xn) ER* 
the element 
$(v) = (X2,... 5 Xny —A1Xn— *** —anXx1) 


of R*, the equation T(x) =0 of 5.2 is equivalent to the equation 
B= $0), 0= (x. +5 Xa) ERM, 


Solutions are functions v: R->R® which associate to each ¢t E R the 
point v(t) = (x(t), ... , xn(t)) € R*. 


6.3 Existence theorems 


The main question left open in Chapter 3 is: for what regions o% 
in R2, and for what functions f:c” +R, does the equation 


dx 
dt =f(t, x), (t, x) E eo, 


have a solution through every point (to, xo) € &”, and when is this 
solution unique? Theorems 3.1 and 3.3 answer the question in the 
special cases f(t, x) = g(t) and f(t, x) = A(x). What is required is a 
theorem which does not give such complete information in these 
special cases, but which on the other hand applies to a more general 
class of functions /. For simplicity we assume that 07 is a rectangle 
{(t, x) € R2:p <t<q and a<x <b} in R®. 


Existence theorem. Let f:c?->R be a continuous function, and 
suppose (to, Xo) € Cf. There is a real number h > such that the equa- 
tion 


dx 
at = f(t, x) 


has a solution ti>x(t) with domain D= {te R:to—h<t<to+h} 
and x(to) = Xo. 


Uniqueness theorem. Let f:°? R be a continuous function for which 
the partial derivative Of/0x is also continuous, and suppose (to, Xo) € &%. 
If the equation 


dx 
F=fe 2) 
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has two solutions x and x with x(to)=X(to)= x0 and domain 
D={tER:to—h<t<to+h} then x(t) = X(t) for allteD. 

These two theorems imply immediately the truth of assumptions 
1.10 and 1.12. The necessity of the additional hypothesis (con- 
tinuity of the partial derivative 0f/0x) in the uniqueness theorem is 
shown by examples 2.5 and 3.4. 

Both theorems have immediate extensions to the case of a 
differential equation 


dv ; 
at =f(t, v) 


where »=(x1,..., Xn) € R® and (¢, v)=(t, x1,..., Xa) lies in a 
region of of R**!. It is this extension, applied to example (ii) of 
6.2, which shows that the linear system of 4.4 has only those solu- 
tions found in 4.5. The same extension, applied to example (iii) 
of 6.2 shows that every solution of the linear equation with constant 
coefficients 7(x) =0 is of the form claimed in 5.2. 

Other extensions of the existence and uniqueness theorems deal 
with the question whether the solution through (to, xo) depends 
continuously on (fo, xo), and with the properties of approximate 
solutions. Here the theoretical discussion is also of great practical 
importance, because it is often possible to compute a numerical 
solution by obtaining closer and closer approximations to it. All 
these matters are discussed in more advanced textbooks on ordinary 
differential equations, such as 


E. A. Coddington and N. Levinson, Theory of ordinary differential 
equations (McGraw-Hill, New York, 1955), 

S. Lefschetz, Differential equations: geometric theory (Inter- 
science, New York; 2nd edition 1962), 

W. Hurewicz, Lectures on ordinary differential equations (M.1.T. 
Press, Cambridge, Mass., 1958). ; 


The latter book is also the best introduction to the qualitative 
theory of differential equations, in which one adopts the approach 
of 4.5 and asks (in higher dimensions, or for a non-linear differential 
equation) what patterns of curves can arise, and which equations are 
structurally stable. 


Notes on 
exercises 


Introduction 


1. y can have arbitrarily small values when x <0. 2. A partially 
correct statement is y=sin (a+ x) for —47<a+x< 4a (see 3.4 
for a complete statement). 3. Function u = 1/x is not defined when 
x=0. 4. First function never makes sense, second function only 
when x = 1. 5. Consider regions x > 0 and x < 0 separately. 6. Solu- 
tion has distinct formulae for x > 0 and x <0. 


Chapter One 


1. Domains of functions given are x > 0, x > 0, all x, x >0, x > 1, 
2nm < x < (2n + 1)z, empty set. 2. (i) a + 21/x for x > 0.(ii)a + logx 
for x >0, and b+log (—x) for x <0. (iii) a+sin x for all x. 
(iv) an + log sin x for 2na < x < (2n + 1)z, and by + log (— sin x) for 
(2n — 1)a < x < 2nz. (v) a + log log x for x > 1 and b + log (— log x) 
for 0 <x <1. (vi) a+ log (— log sin x) for 2na < x < (2n + 1)z. 


Chapter Two 


1. First sketch slope lines along x =0, t=0, x = +14, then fill in 
solution curves. 2. Equations are defined in regions 1>0, all ¢, 
t>0, t>0, all ¢, but first two equations are of second degree with 
two solution curves through each point (t, x) with t>0. 3. If 40 
slopes at (ft, x) are (1/2t)[x + /(x?—41)]. Hence no solutions 
through (t, x) if x2 < 4t, two solutions if x? > 4r. If x? = 4r slope 
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is x/2t = 2/x, that is tangent to parabola x? = 4¢. Therefore x? = 4f 

is a solution curve. Differentiation of equation gives 

(Sy wena Pees 
dt dt dt? \dt gro? 

Therefore either 2¢(dx/dt) = x (in which case x? = 41) or d?x/dt? =0 

(in which case solution curves are straight lines). Therefore all other 

solution curves are tangents to the parabola. 


Chapter Three 
1. (i) x=a+422f? with a= —3 for solution through (1, 0). 
(ii) x =a + bet with a= — be. (iii) x=a+tan-! ¢t with a= — rn. 
(iv) x =a+sinh~! ¢ with a= —log(1+~/2). (v) x =a+sin ¢ with 
=—sin 1. (vi) x=an+log sin t for 2nw7<t<(2n+1)z, and 
x =bn+ log (—sin ft) for (2n — 1)a7 < t < 2nm with ao = — log sin 1, 
b,, arbitrary. 2. (i) x = 1 or x = 2 or x = (aet — 2)/(aet — 1) wherea 0 
with domain R. (ii) x = —log (a — bt) with domain {t € R:a > br}; 
choose a =e! to get unique solution through (0, 1). (iii) x =1 or 
x=1-—(1/t—c) with domain t#c. (iv) x=1 or x=cosh (t—c) 
with domain ¢>c; solution through any point on x=1 is not 
unique. (v) x = 0 or x =(t—c)? with domain t > c; choose c= — | 
to get unique solution through (0, 1). (vi) x =0 or x =sin~} (aet) 
where a #0 with domain t < —log | a|; choose a=sin | to get 
unique solution through (0, 1). 3. (i) Either t=0 or x =0 or 
1-31 
12 


dx 
oa ate 
(2x + x*) = 


which has variables separate. (ii) Since t > 2 either x = — } or 


1 -( 1 ) dx 
t2—4 \142x) dt 
(iii) Substitute u = x/t. (iv) Since t > x > 0 equation can be written 


Pc 2M 
dt 1-—u? 
where u = x/t. (v) Equation becomes (d/dt)(xe**) = 21. (vi) Equation 
becomes (d/dt)(t? + 3tx — 4x2) = 12. 4, (i) Write in form 
4 (.02t) = o3t 
dt (xet) = et, 
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(ii) (d/dt)(x/cos t) =0. (iii) (d/dt)(x cos t) = 2 sin 2¢. (iv) 


d x ve 1 r) 
——- Po =x /t = —1/t 
dt (* r ) on? 


(v) Substitute y=x-3. (vi) Substitute v= log ¢. 5. If t= —e" 
then 


dx dt dx _ de 

du dudt dt 
6. Existence of derivatives at t=0 implies (i) no restrictions, (ii) 
p=r, (iii) p=randq=s. 


Chapter Four 


1. x =xoe~*# has x = 4x9 when — At=log 4 = — log 2. 2. (0, e¢) 
is a solution along x = 0, and (e¢, — et) is a solution along x + y=0. 
Hence (aet, be? — aet) is a solution. Choose a=xo, b=x0+ yo. 
3. Substitution t =e” gives 


d?x dx 

ae 3 ee +2x=0 
and hence x=ae"+be2™=at+bt? for t>0. In region t<0 
substitute t=—e”. 4, (i) (d?x/dt?)—2(dx/dt)+4x=0. (ii) 
(d2x/dt?) + (dx/dt) — 2x =0. (iii) (d#x/dt®) + 2(dx/dt) + x =0. 5. (i) 
x = ae*t + be. (ii) x = (a+ bt)e*. (iii) x = e-2¢ (a cos t+ sin £). 
(iv) x =a+ be-*, 6 (i) x= —et + e%. (ii) x =sin ¢. (iii) x = tet. 
(iv) x =e sin ¢. 


Chapter Five 

1. (i) (iii) (vi) non-linear, (ii) (iv) (v) linear. 

2. (ST )(c1x1 + c2x2) = S(T (c1x1 + c2Xx2)) 
= S(e1T (x1) + c2T(x2)) 
= cyST(x1) + coST (x2); 


S+T similar; 
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(T + aT + b)x = (T + a)(Tx + bx) 
=(T+a)Tx + b(T + a)x 
= (T? + aT + bT + ab)x. 
3. DI(x) = D(tx) =x + tD(x) =x+TD(x). 


4. D(e™g) = D(e™*)g + e™ D(g) = e™mg + e™* D(g). If g isa solution 
(co + cit + *** + y-it'-!) of D'(g)=0 then x= e™g is a solution 
of (D — m)"(x) = 0. 


5. m3 + m2 + m+ 6 =(m + 2)(m? — m4 3) and roots of m2 —m+3 
have positive real part. 


6. Choose x; = e~¢ and x2 = e'. Equations for v1, v2 become 


dv, —et dve et 


a +e? ad d+et 
Integration gives vi =1/(1 + e*). The substitution u=e-t yields 


ve = 2 log (1 + et) +1/(1 + e~*) — et. Therefore there is a particular 
solution: 


t =f et ee 
x = 2et log (1 + ef) + — ot rare 
7. (i) x = aet + be-t — t2 — 2 where a, b are arbitrary real numbers; 
for solution such that x =0, dx/dt=1 when t=0 choose a = 3/2, 
= 1/2. (ii) x = aet + be-t + het with a=1/4, b = —1/4. (iii) 
xX = ae cos (t4/3) + be-* sin (t4/3) + (8/73)et sin 2t + (3/73)et cos 2t 
with a = — 3/73, b =174/3/73. (iv) 


x = ae't sin (: +) + bet cos (: ) + . cos 2t — * sin 2t 
with a =40/13 4/3, b= fa (v) 
2 11 
-t —3t 4 “as ste fos 
x =ae-* +be He p(t sin 2t cos t) + = sin f+ 50 cos ¢t 


with a= 1/4, b = — 47/100. (vi) x=acos t+b sin t+ }¢ sin ¢ with 
a=0,6=1. 
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